2026-02-24T18:10:12.428 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-24T18:10:12.443 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T18:10:12.522 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:22:43-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/68637 branch: wip-yuri6-testing-2026-02-22-1629-squid description: rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/e2e} email: null first_in_suite: false flavor: default job_id: '68637' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-24_16:22:43-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri6-testing-2026-02-22-1629-squid ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 global: mon election default strategy: 3 mds: debug mgrc: 20 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug mgrc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_DEGRADED\) sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2026-02-22-1629-squid sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - mon.a - mgr.a - client.0 - - host.b - client.1 seed: 5907 sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri6-testing-2026-02-22-1629-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 targets: trial052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMB3UGSEWvf8QrlZlk1r4ObAFCyNcyHQV4Ey+mqdMPAXFPMV8qNj5Dr3U1MSqMLYbp1tQae4PiriX3U0mFmLB9I= trial080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNTWNVxn8+wKEsDd22woIeWOQm6rzbwNW3I4KAqbBv+wIOaQ8lHC6WFcJDzkLIF9qHtWvbw3HqPrVK/6QZ9NK5Y= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: null - cephadm: null - ceph: log-ignorelist: - \(OSD_DOWN\) - workunit: clients: client.1: - cephadm/create_iscsi_disks.sh - workunit: clients: client.0: - cephadm/test_dashboard_e2e.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: e6d9099ce03dc21193fda653159ec82465c3a94a timestamp: 2026-02-24_16:22:43 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T18:10:12.522 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa; will attempt to use it 2026-02-24T18:10:12.523 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks 2026-02-24T18:10:12.523 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-24T18:10:12.524 INFO:teuthology.task.internal:Checking packages... 2026-02-24T18:10:12.524 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f90f4eaebb28b619cf76e80cbbe997656da69579' 2026-02-24T18:10:12.524 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-24T18:10:12.524 INFO:teuthology.packaging:ref: None 2026-02-24T18:10:12.524 INFO:teuthology.packaging:tag: None 2026-02-24T18:10:12.524 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-22-1629-squid 2026-02-24T18:10:12.524 INFO:teuthology.packaging:sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-24T18:10:12.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri6-testing-2026-02-22-1629-squid 2026-02-24T18:10:12.644 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689.gf90f4eae 2026-02-24T18:10:12.645 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-24T18:10:12.656 INFO:teuthology.task.internal:no buildpackages task found 2026-02-24T18:10:12.656 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T18:10:12.670 INFO:teuthology.task.internal:Saving configuration 2026-02-24T18:10:12.681 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T18:10:12.692 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T18:10:12.768 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial052.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:22:43-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/68637', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:06:44.457815', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMB3UGSEWvf8QrlZlk1r4ObAFCyNcyHQV4Ey+mqdMPAXFPMV8qNj5Dr3U1MSqMLYbp1tQae4PiriX3U0mFmLB9I='} 2026-02-24T18:10:12.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial080.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:22:43-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/68637', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:06:44.457209', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNTWNVxn8+wKEsDd22woIeWOQm6rzbwNW3I4KAqbBv+wIOaQ8lHC6WFcJDzkLIF9qHtWvbw3HqPrVK/6QZ9NK5Y='} 2026-02-24T18:10:12.828 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T18:10:12.838 INFO:teuthology.task.internal:roles: ubuntu@trial052.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'] 2026-02-24T18:10:12.838 INFO:teuthology.task.internal:roles: ubuntu@trial080.front.sepia.ceph.com - ['host.b', 'client.1'] 2026-02-24T18:10:12.838 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T18:10:12.971 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72f2bd044040>, signals=[15]) 2026-02-24T18:10:12.972 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T18:10:12.982 INFO:teuthology.task.internal:Opening connections... 2026-02-24T18:10:12.983 DEBUG:teuthology.task.internal:connecting to ubuntu@trial052.front.sepia.ceph.com 2026-02-24T18:10:12.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:10:13.046 DEBUG:teuthology.task.internal:connecting to ubuntu@trial080.front.sepia.ceph.com 2026-02-24T18:10:13.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:10:13.107 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T18:10:13.118 DEBUG:teuthology.orchestra.run.trial052:> uname -m 2026-02-24T18:10:13.134 INFO:teuthology.orchestra.run.trial052.stdout:x86_64 2026-02-24T18:10:13.134 DEBUG:teuthology.orchestra.run.trial052:> cat /etc/os-release 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:NAME="CentOS Stream" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:VERSION="9" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:ID="centos" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:VERSION_ID="9" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:ANSI_COLOR="0;31" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:10:13.190 INFO:teuthology.orchestra.run.trial052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:10:13.190 INFO:teuthology.lock.ops:Updating trial052.front.sepia.ceph.com on lock server 2026-02-24T18:10:13.249 DEBUG:teuthology.orchestra.run.trial080:> uname -m 2026-02-24T18:10:13.265 INFO:teuthology.orchestra.run.trial080.stdout:x86_64 2026-02-24T18:10:13.266 DEBUG:teuthology.orchestra.run.trial080:> cat /etc/os-release 2026-02-24T18:10:13.321 INFO:teuthology.orchestra.run.trial080.stdout:NAME="CentOS Stream" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:VERSION="9" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:ID="centos" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:VERSION_ID="9" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:ANSI_COLOR="0;31" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:10:13.322 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:10:13.322 INFO:teuthology.lock.ops:Updating trial080.front.sepia.ceph.com on lock server 2026-02-24T18:10:13.395 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T18:10:13.407 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T18:10:13.419 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T18:10:13.419 DEBUG:teuthology.orchestra.run.trial052:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:10:13.421 DEBUG:teuthology.orchestra.run.trial080:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:10:13.435 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T18:10:13.446 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T18:10:13.446 DEBUG:teuthology.orchestra.run.trial052:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:10:13.476 DEBUG:teuthology.orchestra.run.trial080:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:10:13.492 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T18:10:13.654 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T18:10:13.673 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-24T18:10:13.673 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-24T18:10:13.673 DEBUG:teuthology.orchestra.run.trial052:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:10:13.674 DEBUG:teuthology.orchestra.run.trial080:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:10:13.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:10:13.688 DEBUG:teuthology.orchestra.run.trial052:> uname -r 2026-02-24T18:10:13.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:10:13.689 DEBUG:teuthology.orchestra.run.trial080:> uname -r 2026-02-24T18:10:13.744 INFO:teuthology.orchestra.run.trial080.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:10:13.744 INFO:teuthology.task.kernel:Running kernel on trial080: 5.14.0-681.el9.x86_64 2026-02-24T18:10:13.744 DEBUG:teuthology.orchestra.run.trial080:> sudo yum install -y kernel 2026-02-24T18:10:13.745 INFO:teuthology.orchestra.run.trial052.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:10:13.745 INFO:teuthology.task.kernel:Running kernel on trial052: 5.14.0-681.el9.x86_64 2026-02-24T18:10:13.745 DEBUG:teuthology.orchestra.run.trial052:> sudo yum install -y kernel 2026-02-24T18:10:15.211 INFO:teuthology.orchestra.run.trial052.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.9 MB 00:01 2026-02-24T18:10:15.463 INFO:teuthology.orchestra.run.trial080.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.9 MB 00:01 2026-02-24T18:10:17.790 INFO:teuthology.orchestra.run.trial052.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-24T18:10:21.066 INFO:teuthology.orchestra.run.trial052.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 8.0 MB 00:00 2026-02-24T18:10:21.917 INFO:teuthology.orchestra.run.trial052.stdout:CentOS Stream 9 - Extras packages 176 kB/s | 20 kB 00:00 2026-02-24T18:10:22.546 INFO:teuthology.orchestra.run.trial052.stdout:Extra Packages for Enterprise Linux 36 MB/s | 20 MB 00:00 2026-02-24T18:10:25.714 INFO:teuthology.orchestra.run.trial052.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T18:10:26.723 INFO:teuthology.orchestra.run.trial052.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:10:26.723 INFO:teuthology.orchestra.run.trial052.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:10:26.743 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:10:26.744 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:10:26.744 INFO:teuthology.orchestra.run.trial052.stdout: Package Architecture Version Repository Size 2026-02-24T18:10:26.744 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout:Installing dependencies: 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout:Install 4 Packages 2026-02-24T18:10:26.745 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:10:26.746 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 89 M 2026-02-24T18:10:26.746 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 135 M 2026-02-24T18:10:26.746 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:10:26.960 INFO:teuthology.orchestra.run.trial052.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 6.6 MB/s | 901 kB 00:00 2026-02-24T18:10:27.435 INFO:teuthology.orchestra.run.trial052.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 28 MB/s | 17 MB 00:00 2026-02-24T18:10:27.849 INFO:teuthology.orchestra.run.trial052.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 35 MB/s | 31 MB 00:00 2026-02-24T18:10:28.072 INFO:teuthology.orchestra.run.trial052.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 32 MB/s | 40 MB 00:01 2026-02-24T18:10:28.073 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:10:28.073 INFO:teuthology.orchestra.run.trial052.stdout:Total 67 MB/s | 89 MB 00:01 2026-02-24T18:10:28.263 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:10:28.466 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:10:28.466 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:10:28.851 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:10:28.852 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:10:29.959 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:10:30.249 INFO:teuthology.orchestra.run.trial052.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:10:30.271 INFO:teuthology.orchestra.run.trial052.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:10:32.843 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:10:32.875 INFO:teuthology.orchestra.run.trial052.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:10:36.138 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:10:36.145 INFO:teuthology.orchestra.run.trial052.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:10:39.196 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:10:44.030 INFO:teuthology.orchestra.run.trial080.stdout:CentOS Stream 9 - AppStream 985 kB/s | 27 MB 00:28 2026-02-24T18:10:50.053 INFO:teuthology.orchestra.run.trial080.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 8.0 MB 00:03 2026-02-24T18:10:50.962 INFO:teuthology.orchestra.run.trial080.stdout:CentOS Stream 9 - Extras packages 113 kB/s | 20 kB 00:00 2026-02-24T18:10:51.491 INFO:teuthology.orchestra.run.trial080.stdout:Extra Packages for Enterprise Linux 44 MB/s | 20 MB 00:00 2026-02-24T18:10:54.691 INFO:teuthology.orchestra.run.trial080.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T18:10:55.711 INFO:teuthology.orchestra.run.trial080.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:10:55.711 INFO:teuthology.orchestra.run.trial080.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:10:55.731 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:10:55.732 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:10:55.732 INFO:teuthology.orchestra.run.trial080.stdout: Package Architecture Version Repository Size 2026-02-24T18:10:55.732 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:10:55.732 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout:Installing dependencies: 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout:Install 4 Packages 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:10:55.733 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 89 M 2026-02-24T18:10:55.734 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 135 M 2026-02-24T18:10:55.734 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:10:55.927 INFO:teuthology.orchestra.run.trial080.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 6.9 MB/s | 901 kB 00:00 2026-02-24T18:10:56.338 INFO:teuthology.orchestra.run.trial080.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 32 MB/s | 17 MB 00:00 2026-02-24T18:10:56.558 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:10:56.580 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:10:56.745 INFO:teuthology.orchestra.run.trial080.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 38 MB/s | 31 MB 00:00 2026-02-24T18:10:56.767 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:10:56.767 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:10:56.767 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:10:56.767 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:10:56.825 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:10:56.825 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:10:56.825 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:10:56.826 INFO:teuthology.orchestra.run.trial052.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:10:56.826 INFO:teuthology.orchestra.run.trial052.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:10:56.826 INFO:teuthology.orchestra.run.trial052.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:10:56.826 INFO:teuthology.orchestra.run.trial052.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:10:56.826 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:10:56.826 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:10:56.887 DEBUG:teuthology.orchestra.run.trial052:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:10:56.916 INFO:teuthology.orchestra.run.trial052.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:10:56.917 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:10:56.917 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:10:56.918 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:10:56.918 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:10:56.918 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-24T18:10:56.918 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial052.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:10:56.918 DEBUG:teuthology.orchestra.run.trial052:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:10:56.964 INFO:teuthology.orchestra.run.trial080.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 34 MB/s | 40 MB 00:01 2026-02-24T18:10:56.965 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:10:56.965 INFO:teuthology.orchestra.run.trial080.stdout:Total 72 MB/s | 89 MB 00:01 2026-02-24T18:10:56.984 INFO:teuthology.orchestra.run.trial052.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:10:56.984 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:10:56.985 DEBUG:teuthology.orchestra.run.trial052:> sudo rpm -qi grub2-tools 2026-02-24T18:10:57.053 INFO:teuthology.orchestra.run.trial052.stdout:Name : grub2-tools 2026-02-24T18:10:57.054 INFO:teuthology.orchestra.run.trial052.stdout:Epoch : 1 2026-02-24T18:10:57.054 INFO:teuthology.orchestra.run.trial052.stdout:Version : 2.06 2026-02-24T18:10:57.054 INFO:teuthology.orchestra.run.trial052.stdout:Release : 120.el9 2026-02-24T18:10:57.054 INFO:teuthology.orchestra.run.trial052.stdout:Architecture: x86_64 2026-02-24T18:10:57.054 INFO:teuthology.orchestra.run.trial052.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:10:57.054 INFO:teuthology.orchestra.run.trial052.stdout:Group : Unspecified 2026-02-24T18:10:57.054 INFO:teuthology.orchestra.run.trial052.stdout:Size : 9108611 2026-02-24T18:10:57.054 INFO:teuthology.orchestra.run.trial052.stdout:License : GPLv3+ 2026-02-24T18:10:57.054 INFO:teuthology.orchestra.run.trial052.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout:Packager : builder@centos.org 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout:Vendor : CentOS 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout:Summary : Support tools for GRUB. 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout:Description : 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:10:57.055 INFO:teuthology.orchestra.run.trial052.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:10:57.056 INFO:teuthology.orchestra.run.trial052.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:10:57.056 INFO:teuthology.orchestra.run.trial052.stdout:hardware devices. 2026-02-24T18:10:57.056 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:10:57.056 INFO:teuthology.orchestra.run.trial052.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:10:57.057 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:10:57.057 INFO:teuthology.task.kernel:Updating grub on trial052 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:10:57.057 DEBUG:teuthology.orchestra.run.trial052:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:10:57.119 INFO:teuthology.orchestra.run.trial052.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:10:57.121 DEBUG:teuthology.orchestra.run.trial052:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:10:57.158 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:10:57.183 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/grubby 2026-02-24T18:10:57.184 INFO:teuthology.orchestra.run.trial052.stdout:yes 2026-02-24T18:10:57.184 DEBUG:teuthology.orchestra.run.trial052:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:10:57.248 INFO:teuthology.orchestra.run.trial052.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:10:57.249 DEBUG:teuthology.orchestra.run.trial052:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:10:57.323 DEBUG:teuthology.orchestra.run.trial052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:10:57.357 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:10:57.357 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:10:57.528 INFO:teuthology.orchestra.run.trial052.stderr:Generating grub configuration file ... 2026-02-24T18:10:57.594 INFO:teuthology.orchestra.run.trial052.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:10:57.601 INFO:teuthology.orchestra.run.trial052.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:10:57.737 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:10:57.738 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:10:57.846 INFO:teuthology.orchestra.run.trial052.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:10:57.854 INFO:teuthology.orchestra.run.trial052.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:10:57.888 INFO:teuthology.orchestra.run.trial052.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:10:57.894 INFO:teuthology.orchestra.run.trial052.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:10:57.925 INFO:teuthology.orchestra.run.trial052.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:10:57.932 INFO:teuthology.orchestra.run.trial052.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:10:57.955 INFO:teuthology.orchestra.run.trial052.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:10:57.961 INFO:teuthology.orchestra.run.trial052.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:10:58.048 INFO:teuthology.orchestra.run.trial052.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:10:58.056 INFO:teuthology.orchestra.run.trial052.stderr:done 2026-02-24T18:10:58.058 DEBUG:teuthology.orchestra.run.trial052:> test -d /sys/firmware/efi 2026-02-24T18:10:58.074 DEBUG:teuthology.orchestra.run.trial052:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:10:58.138 INFO:teuthology.orchestra.run.trial052.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:10:58.139 INFO:teuthology.orchestra.run.trial052.stdout:/boot/efi/EFI/centos 2026-02-24T18:10:58.140 DEBUG:teuthology.orchestra.run.trial052:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:10:58.206 INFO:teuthology.orchestra.run.trial052.stdout:no 2026-02-24T18:10:58.207 DEBUG:teuthology.orchestra.run.trial052:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:10:58.272 INFO:teuthology.orchestra.run.trial052.stdout:yes 2026-02-24T18:10:58.272 DEBUG:teuthology.orchestra.run.trial052:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:10:58.336 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial052 2026-02-24T18:10:58.336 DEBUG:teuthology.orchestra.run.trial052:> sudo bash -c ' 2026-02-24T18:10:58.336 DEBUG:teuthology.orchestra.run.trial052:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:10:58.336 DEBUG:teuthology.orchestra.run.trial052:> ' 2026-02-24T18:10:58.840 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:10:59.128 INFO:teuthology.orchestra.run.trial080.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:10:59.150 INFO:teuthology.orchestra.run.trial080.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:11:01.693 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:11:01.727 INFO:teuthology.orchestra.run.trial080.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:11:04.831 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:11:04.838 INFO:teuthology.orchestra.run.trial080.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:11:07.891 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:11:25.270 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:11:25.293 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:11:25.479 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:11:25.480 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:11:25.480 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:11:25.480 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:11:25.536 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:11:25.536 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:11:25.536 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:11:25.537 INFO:teuthology.orchestra.run.trial080.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:11:25.537 INFO:teuthology.orchestra.run.trial080.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:11:25.537 INFO:teuthology.orchestra.run.trial080.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:11:25.537 INFO:teuthology.orchestra.run.trial080.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:11:25.538 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:11:25.538 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:11:25.598 DEBUG:teuthology.orchestra.run.trial080:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:11:25.629 INFO:teuthology.orchestra.run.trial080.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:11:25.629 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:11:25.630 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:11:25.630 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:11:25.630 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:11:25.630 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-24T18:11:25.630 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial080.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:11:25.631 DEBUG:teuthology.orchestra.run.trial080:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:11:25.693 INFO:teuthology.orchestra.run.trial080.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:11:25.694 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:11:25.694 DEBUG:teuthology.orchestra.run.trial080:> sudo rpm -qi grub2-tools 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Name : grub2-tools 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Epoch : 1 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Version : 2.06 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Release : 120.el9 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Architecture: x86_64 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Group : Unspecified 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Size : 9108611 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:License : GPLv3+ 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:11:25.762 INFO:teuthology.orchestra.run.trial080.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:Packager : builder@centos.org 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:Vendor : CentOS 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:Summary : Support tools for GRUB. 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:Description : 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:hardware devices. 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:11:25.763 INFO:teuthology.orchestra.run.trial080.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:11:25.764 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:11:25.764 INFO:teuthology.task.kernel:Updating grub on trial080 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:11:25.764 DEBUG:teuthology.orchestra.run.trial080:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:11:25.828 INFO:teuthology.orchestra.run.trial080.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:11:25.829 DEBUG:teuthology.orchestra.run.trial080:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:11:25.893 INFO:teuthology.orchestra.run.trial080.stdout:/sbin/grubby 2026-02-24T18:11:25.894 INFO:teuthology.orchestra.run.trial080.stdout:yes 2026-02-24T18:11:25.894 DEBUG:teuthology.orchestra.run.trial080:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:11:25.958 INFO:teuthology.orchestra.run.trial080.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:11:25.959 DEBUG:teuthology.orchestra.run.trial080:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:11:26.033 DEBUG:teuthology.orchestra.run.trial080:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:11:26.242 INFO:teuthology.orchestra.run.trial080.stderr:Generating grub configuration file ... 2026-02-24T18:11:26.311 INFO:teuthology.orchestra.run.trial080.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:11:26.318 INFO:teuthology.orchestra.run.trial080.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:11:26.567 INFO:teuthology.orchestra.run.trial080.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:11:26.574 INFO:teuthology.orchestra.run.trial080.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:11:26.607 INFO:teuthology.orchestra.run.trial080.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:11:26.614 INFO:teuthology.orchestra.run.trial080.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:11:26.646 INFO:teuthology.orchestra.run.trial080.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:11:26.652 INFO:teuthology.orchestra.run.trial080.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:11:26.675 INFO:teuthology.orchestra.run.trial080.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:11:26.681 INFO:teuthology.orchestra.run.trial080.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:11:26.767 INFO:teuthology.orchestra.run.trial080.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:11:26.775 INFO:teuthology.orchestra.run.trial080.stderr:done 2026-02-24T18:11:26.777 DEBUG:teuthology.orchestra.run.trial080:> test -d /sys/firmware/efi 2026-02-24T18:11:26.793 DEBUG:teuthology.orchestra.run.trial080:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:11:26.859 INFO:teuthology.orchestra.run.trial080.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:11:26.859 INFO:teuthology.orchestra.run.trial080.stdout:/boot/efi/EFI/centos 2026-02-24T18:11:26.860 DEBUG:teuthology.orchestra.run.trial080:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:11:26.927 INFO:teuthology.orchestra.run.trial080.stdout:no 2026-02-24T18:11:26.927 DEBUG:teuthology.orchestra.run.trial080:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:11:26.992 INFO:teuthology.orchestra.run.trial080.stdout:yes 2026-02-24T18:11:26.992 DEBUG:teuthology.orchestra.run.trial080:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:11:27.057 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial080 2026-02-24T18:11:27.057 DEBUG:teuthology.orchestra.run.trial080:> sudo bash -c ' 2026-02-24T18:11:27.058 DEBUG:teuthology.orchestra.run.trial080:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:11:27.058 DEBUG:teuthology.orchestra.run.trial080:> ' 2026-02-24T18:11:28.379 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-24T18:11:28.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial052.front.sepia.ceph.com' 2026-02-24T18:11:28.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:11:57.100 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-24T18:11:57.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-24T18:11:57.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:12:28.414 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:12:37.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial052.front.sepia.ceph.com' 2026-02-24T18:12:37.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:12:37.564 DEBUG:teuthology.orchestra.run.trial052:> true 2026-02-24T18:12:37.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial052.front.sepia.ceph.com' 2026-02-24T18:12:37.724 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:12:37.724 DEBUG:teuthology.orchestra.run.trial052:> uname -r 2026-02-24T18:12:37.779 INFO:teuthology.orchestra.run.trial052.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:12:37.780 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:12:37.780 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:12:37.780 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:12:38.781 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-24T18:12:38.781 DEBUG:teuthology.orchestra.run.trial052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:12:38.812 INFO:teuthology.orchestra.run.trial052.stdout:ttyS1 2026-02-24T18:12:38.837 DEBUG:teuthology.parallel:result is None 2026-02-24T18:12:57.103 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:13:06.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-24T18:13:06.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:13:06.193 DEBUG:teuthology.orchestra.run.trial080:> true 2026-02-24T18:13:06.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-24T18:13:06.351 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:13:06.351 DEBUG:teuthology.orchestra.run.trial080:> uname -r 2026-02-24T18:13:06.407 INFO:teuthology.orchestra.run.trial080.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:13:06.408 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:13:06.408 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:13:06.408 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:13:07.409 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-24T18:13:07.409 DEBUG:teuthology.orchestra.run.trial080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:13:07.440 INFO:teuthology.orchestra.run.trial080.stdout:ttyS1 2026-02-24T18:13:07.467 DEBUG:teuthology.parallel:result is None 2026-02-24T18:13:07.468 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T18:13:07.479 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T18:13:07.479 DEBUG:teuthology.orchestra.run.trial052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:13:07.482 DEBUG:teuthology.orchestra.run.trial080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:13:07.524 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T18:13:07.535 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T18:13:07.549 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T18:13:07.550 DEBUG:teuthology.orchestra.run.trial052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:13:07.552 DEBUG:teuthology.orchestra.run.trial080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:13:07.587 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T18:13:07.599 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T18:13:07.599 DEBUG:teuthology.orchestra.run.trial052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:13:07.608 DEBUG:teuthology.orchestra.run.trial080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:13:07.630 INFO:teuthology.orchestra.run.trial052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:13:07.639 INFO:teuthology.orchestra.run.trial052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:13:07.644 INFO:teuthology.orchestra.run.trial080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:13:07.653 INFO:teuthology.orchestra.run.trial080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:13:07.655 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T18:13:07.669 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T18:13:07.669 DEBUG:teuthology.orchestra.run.trial052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:13:07.683 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:13:07.719 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T18:13:07.732 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T18:13:07.732 DEBUG:teuthology.orchestra.run.trial052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:13:07.747 DEBUG:teuthology.orchestra.run.trial080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:13:07.775 DEBUG:teuthology.orchestra.run.trial052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:13:07.924 DEBUG:teuthology.orchestra.run.trial052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:13:07.949 DEBUG:teuthology.orchestra.run.trial052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:13:08.089 DEBUG:teuthology.orchestra.run.trial052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:13:08.113 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:13:08.113 DEBUG:teuthology.orchestra.run.trial052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:13:08.175 DEBUG:teuthology.orchestra.run.trial080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:13:08.268 DEBUG:teuthology.orchestra.run.trial080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:13:08.293 DEBUG:teuthology.orchestra.run.trial080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:13:08.435 DEBUG:teuthology.orchestra.run.trial080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:13:08.460 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:13:08.460 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:13:08.524 DEBUG:teuthology.orchestra.run.trial052:> sudo service rsyslog restart 2026-02-24T18:13:08.526 DEBUG:teuthology.orchestra.run.trial080:> sudo service rsyslog restart 2026-02-24T18:13:08.553 INFO:teuthology.orchestra.run.trial052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:13:08.593 INFO:teuthology.orchestra.run.trial080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:13:08.998 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T18:13:09.009 INFO:teuthology.task.internal:Starting timer... 2026-02-24T18:13:09.010 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T18:13:09.029 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T18:13:09.041 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-24T18:13:09.041 DEBUG:teuthology.orchestra.run.trial052:> sudo service auditd rotate 2026-02-24T18:13:09.068 INFO:teuthology.orchestra.run.trial052.stdout:Rotating logs: 2026-02-24T18:13:09.070 DEBUG:teuthology.orchestra.run.trial080:> sudo service auditd rotate 2026-02-24T18:13:09.101 INFO:teuthology.orchestra.run.trial080.stdout:Rotating logs: 2026-02-24T18:13:09.102 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T18:13:09.102 DEBUG:teuthology.orchestra.run.trial052:> /usr/sbin/getenforce 2026-02-24T18:13:09.126 INFO:teuthology.orchestra.run.trial052.stdout:Permissive 2026-02-24T18:13:09.126 DEBUG:teuthology.orchestra.run.trial080:> /usr/sbin/getenforce 2026-02-24T18:13:09.159 INFO:teuthology.orchestra.run.trial080.stdout:Permissive 2026-02-24T18:13:09.159 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial052.front.sepia.ceph.com': 'permissive', 'ubuntu@trial080.front.sepia.ceph.com': 'permissive'} 2026-02-24T18:13:09.160 DEBUG:teuthology.orchestra.run.trial052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-24T18:13:09.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:13:09.190 DEBUG:teuthology.orchestra.run.trial080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-24T18:13:09.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:13:09.225 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T18:13:09.225 DEBUG:teuthology.orchestra.run.trial052:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:13:09.254 DEBUG:teuthology.orchestra.run.trial080:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:13:09.289 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T18:13:09.305 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-24T18:13:09.308 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-24T18:13:09.425 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T18:13:09.432 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T18:13:09.433 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial052.front.sepia.ceph.com,trial080.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T18:16:04.699 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial052.front.sepia.ceph.com'), Remote(name='ubuntu@trial080.front.sepia.ceph.com')] 2026-02-24T18:16:04.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial052.front.sepia.ceph.com' 2026-02-24T18:16:04.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:16:04.852 DEBUG:teuthology.orchestra.run.trial052:> true 2026-02-24T18:16:04.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial052.front.sepia.ceph.com' 2026-02-24T18:16:04.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-24T18:16:04.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:16:05.009 DEBUG:teuthology.orchestra.run.trial080:> true 2026-02-24T18:16:05.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-24T18:16:05.083 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T18:16:05.096 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T18:16:05.096 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:16:05.097 DEBUG:teuthology.orchestra.run.trial052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:16:05.099 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:16:05.099 DEBUG:teuthology.orchestra.run.trial080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:16:05.124 INFO:teuthology.orchestra.run.trial052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:16:05.136 INFO:teuthology.orchestra.run.trial052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:16:05.149 INFO:teuthology.orchestra.run.trial080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:16:05.156 INFO:teuthology.orchestra.run.trial052.stderr:sudo: ntpd: command not found 2026-02-24T18:16:05.162 INFO:teuthology.orchestra.run.trial080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:16:05.166 INFO:teuthology.orchestra.run.trial052.stdout:506 Cannot talk to daemon 2026-02-24T18:16:05.178 INFO:teuthology.orchestra.run.trial052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:16:05.183 INFO:teuthology.orchestra.run.trial080.stderr:sudo: ntpd: command not found 2026-02-24T18:16:05.189 INFO:teuthology.orchestra.run.trial052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:16:05.193 INFO:teuthology.orchestra.run.trial080.stdout:506 Cannot talk to daemon 2026-02-24T18:16:05.204 INFO:teuthology.orchestra.run.trial080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:16:05.216 INFO:teuthology.orchestra.run.trial080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:16:05.241 INFO:teuthology.orchestra.run.trial052.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:16:05.242 INFO:teuthology.orchestra.run.trial052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:16:05.242 INFO:teuthology.orchestra.run.trial052.stdout:=============================================================================== 2026-02-24T18:16:05.269 INFO:teuthology.orchestra.run.trial080.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:16:05.284 INFO:teuthology.orchestra.run.trial080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:16:05.284 INFO:teuthology.orchestra.run.trial080.stdout:=============================================================================== 2026-02-24T18:16:05.284 INFO:teuthology.orchestra.run.trial080.stdout:^? 69.9.131.124 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:16:05.284 INFO:teuthology.orchestra.run.trial080.stdout:^? 50.205.57.38 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:16:05.286 INFO:teuthology.run_tasks:Running task pexec... 2026-02-24T18:16:05.303 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-24T18:16:05.304 DEBUG:teuthology.orchestra.run.trial052:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-24T18:16:05.305 DEBUG:teuthology.orchestra.run.trial080:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-24T18:16:05.308 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial052.front.sepia.ceph.com 2026-02-24T18:16:05.308 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-24T18:16:05.308 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-24T18:16:05.328 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial080.front.sepia.ceph.com 2026-02-24T18:16:05.329 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-24T18:16:05.329 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-24T18:16:05.485 INFO:teuthology.orchestra.run.trial052.stdout:No match for argument: nvme-cli 2026-02-24T18:16:05.485 INFO:teuthology.orchestra.run.trial052.stderr:No packages marked for removal. 2026-02-24T18:16:05.487 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:05.488 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:16:05.488 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:05.506 INFO:teuthology.orchestra.run.trial080.stdout:No match for argument: nvme-cli 2026-02-24T18:16:05.506 INFO:teuthology.orchestra.run.trial080.stderr:No packages marked for removal. 2026-02-24T18:16:05.508 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:05.509 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:16:05.509 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:05.796 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:37 ago on Tue 24 Feb 2026 06:15:28 PM UTC. 2026-02-24T18:16:05.816 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:37 ago on Tue 24 Feb 2026 06:15:28 PM UTC. 2026-02-24T18:16:05.877 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:05.878 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:05.879 INFO:teuthology.orchestra.run.trial052.stdout: Package Architecture Version Repository Size 2026-02-24T18:16:05.879 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:05.879 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:16:05.879 INFO:teuthology.orchestra.run.trial052.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T18:16:05.879 INFO:teuthology.orchestra.run.trial052.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-24T18:16:05.879 INFO:teuthology.orchestra.run.trial052.stdout:Installing dependencies: 2026-02-24T18:16:05.879 INFO:teuthology.orchestra.run.trial052.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-24T18:16:05.879 INFO:teuthology.orchestra.run.trial052.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-24T18:16:05.879 INFO:teuthology.orchestra.run.trial052.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:16:05.879 INFO:teuthology.orchestra.run.trial052.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-24T18:16:05.880 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:05.880 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:16:05.880 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:05.880 INFO:teuthology.orchestra.run.trial052.stdout:Install 6 Packages 2026-02-24T18:16:05.880 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:05.880 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 2.3 M 2026-02-24T18:16:05.880 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 11 M 2026-02-24T18:16:05.880 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:16:05.898 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:05.899 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:05.899 INFO:teuthology.orchestra.run.trial080.stdout: Package Architecture Version Repository Size 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout:Installing dependencies: 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:16:05.900 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:05.901 INFO:teuthology.orchestra.run.trial080.stdout:Install 6 Packages 2026-02-24T18:16:05.901 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:05.901 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 2.3 M 2026-02-24T18:16:05.901 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 11 M 2026-02-24T18:16:05.901 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:16:06.097 INFO:teuthology.orchestra.run.trial080.stdout:(1/6): nvmetcli-0.8-3.el9.noarch.rpm 408 kB/s | 44 kB 00:00 2026-02-24T18:16:06.112 INFO:teuthology.orchestra.run.trial080.stdout:(2/6): python3-configshell-1.1.30-1.el9.noarch. 587 kB/s | 72 kB 00:00 2026-02-24T18:16:06.153 INFO:teuthology.orchestra.run.trial080.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 1.5 MB/s | 84 kB 00:00 2026-02-24T18:16:06.178 INFO:teuthology.orchestra.run.trial080.stdout:(4/6): python3-pyparsing-2.4.7-9.el9.noarch.rpm 2.2 MB/s | 150 kB 00:00 2026-02-24T18:16:06.210 INFO:teuthology.orchestra.run.trial080.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 5.2 MB/s | 1.2 MB 00:00 2026-02-24T18:16:06.255 INFO:teuthology.orchestra.run.trial080.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 8.0 MB/s | 837 kB 00:00 2026-02-24T18:16:06.255 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:06.255 INFO:teuthology.orchestra.run.trial080.stdout:Total 6.5 MB/s | 2.3 MB 00:00 2026-02-24T18:16:06.309 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:16:06.316 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:16:06.316 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:16:06.377 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:16:06.377 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:16:06.471 INFO:teuthology.orchestra.run.trial052.stdout:(1/6): nvmetcli-0.8-3.el9.noarch.rpm 652 kB/s | 44 kB 00:00 2026-02-24T18:16:06.471 INFO:teuthology.orchestra.run.trial052.stdout:(2/6): python3-configshell-1.1.30-1.el9.noarch. 1.0 MB/s | 72 kB 00:00 2026-02-24T18:16:06.512 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:16:06.514 INFO:teuthology.orchestra.run.trial052.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 1.9 MB/s | 84 kB 00:00 2026-02-24T18:16:06.516 INFO:teuthology.orchestra.run.trial052.stdout:(4/6): python3-pyparsing-2.4.7-9.el9.noarch.rpm 3.3 MB/s | 150 kB 00:00 2026-02-24T18:16:06.519 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2026-02-24T18:16:06.528 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/6 2026-02-24T18:16:06.534 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-02-24T18:16:06.535 INFO:teuthology.orchestra.run.trial052.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 8.8 MB/s | 1.2 MB 00:00 2026-02-24T18:16:06.539 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/6 2026-02-24T18:16:06.540 INFO:teuthology.orchestra.run.trial080.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/6 2026-02-24T18:16:06.581 INFO:teuthology.orchestra.run.trial052.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 12 MB/s | 837 kB 00:00 2026-02-24T18:16:06.582 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:06.582 INFO:teuthology.orchestra.run.trial052.stdout:Total 3.3 MB/s | 2.3 MB 00:00 2026-02-24T18:16:06.634 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:16:06.641 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:16:06.641 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:16:06.671 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/6 2026-02-24T18:16:06.673 INFO:teuthology.orchestra.run.trial080.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/6 2026-02-24T18:16:06.704 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:16:06.704 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:16:06.835 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:16:06.843 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2026-02-24T18:16:06.851 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/6 2026-02-24T18:16:06.857 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-02-24T18:16:06.862 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/6 2026-02-24T18:16:06.863 INFO:teuthology.orchestra.run.trial052.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/6 2026-02-24T18:16:06.950 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/6 2026-02-24T18:16:06.950 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T18:16:06.951 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:06.991 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/6 2026-02-24T18:16:06.993 INFO:teuthology.orchestra.run.trial052.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/6 2026-02-24T18:16:07.191 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/6 2026-02-24T18:16:07.191 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/6 2026-02-24T18:16:07.191 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-02-24T18:16:07.191 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/6 2026-02-24T18:16:07.191 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/6 2026-02-24T18:16:07.249 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2026-02-24T18:16:07.249 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:07.249 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:16:07.249 INFO:teuthology.orchestra.run.trial080.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-24T18:16:07.249 INFO:teuthology.orchestra.run.trial080.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-24T18:16:07.249 INFO:teuthology.orchestra.run.trial080.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-24T18:16:07.250 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:07.250 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:07.266 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/6 2026-02-24T18:16:07.266 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T18:16:07.266 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:07.279 DEBUG:teuthology.parallel:result is None 2026-02-24T18:16:07.523 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/6 2026-02-24T18:16:07.523 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/6 2026-02-24T18:16:07.524 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-02-24T18:16:07.524 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/6 2026-02-24T18:16:07.524 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/6 2026-02-24T18:16:07.580 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2026-02-24T18:16:07.581 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:07.581 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:16:07.581 INFO:teuthology.orchestra.run.trial052.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-24T18:16:07.581 INFO:teuthology.orchestra.run.trial052.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-24T18:16:07.581 INFO:teuthology.orchestra.run.trial052.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-24T18:16:07.581 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:07.581 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:07.611 DEBUG:teuthology.parallel:result is None 2026-02-24T18:16:07.612 INFO:teuthology.run_tasks:Running task install... 2026-02-24T18:16:07.627 DEBUG:teuthology.task.install:project ceph 2026-02-24T18:16:07.627 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}} 2026-02-24T18:16:07.628 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-24T18:16:07.628 INFO:teuthology.task.install:Using flavor: default 2026-02-24T18:16:07.637 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-24T18:16:07.637 INFO:teuthology.task.install:extra packages: [] 2026-02-24T18:16:07.637 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-24T18:16:07.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-24T18:16:07.640 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-24T18:16:07.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-24T18:16:07.843 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-24T18:16:07.843 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-24T18:16:07.853 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-24T18:16:07.853 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-24T18:16:07.986 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:16:07.986 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:16:07.986 DEBUG:teuthology.orchestra.run.trial052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:16:07.996 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:16:07.996 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:16:07.996 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:16:08.015 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-24T18:16:08.016 DEBUG:teuthology.orchestra.run.trial052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:16:08.023 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-24T18:16:08.023 DEBUG:teuthology.orchestra.run.trial080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:16:08.081 DEBUG:teuthology.orchestra.run.trial052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:16:08.089 DEBUG:teuthology.orchestra.run.trial080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:16:08.156 DEBUG:teuthology.orchestra.run.trial052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:16:08.163 DEBUG:teuthology.orchestra.run.trial080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:16:08.219 INFO:teuthology.orchestra.run.trial052.stdout:check_obsoletes = 1 2026-02-24T18:16:08.221 DEBUG:teuthology.orchestra.run.trial052:> sudo yum clean all 2026-02-24T18:16:08.227 INFO:teuthology.orchestra.run.trial080.stdout:check_obsoletes = 1 2026-02-24T18:16:08.229 DEBUG:teuthology.orchestra.run.trial080:> sudo yum clean all 2026-02-24T18:16:08.369 INFO:teuthology.orchestra.run.trial052.stdout:41 files removed 2026-02-24T18:16:08.378 INFO:teuthology.orchestra.run.trial080.stdout:41 files removed 2026-02-24T18:16:08.383 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-radosgw 2026-02-24T18:16:08.392 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-radosgw 2026-02-24T18:16:08.671 INFO:teuthology.orchestra.run.trial080.stdout:ceph packages for x86_64 667 kB/s | 86 kB 00:00 2026-02-24T18:16:08.675 INFO:teuthology.orchestra.run.trial052.stdout:ceph packages for x86_64 674 kB/s | 86 kB 00:00 2026-02-24T18:16:08.808 INFO:teuthology.orchestra.run.trial080.stdout:ceph noarch packages 110 kB/s | 12 kB 00:00 2026-02-24T18:16:08.809 INFO:teuthology.orchestra.run.trial052.stdout:ceph noarch packages 113 kB/s | 12 kB 00:00 2026-02-24T18:16:08.936 INFO:teuthology.orchestra.run.trial080.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-24T18:16:08.938 INFO:teuthology.orchestra.run.trial052.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-24T18:16:09.291 INFO:teuthology.orchestra.run.trial052.stdout:CentOS Stream 9 - BaseOS 27 MB/s | 8.9 MB 00:00 2026-02-24T18:16:09.746 INFO:teuthology.orchestra.run.trial080.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-24T18:16:12.689 INFO:teuthology.orchestra.run.trial052.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 27 MB 00:02 2026-02-24T18:16:12.903 INFO:teuthology.orchestra.run.trial080.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-24T18:16:16.011 INFO:teuthology.orchestra.run.trial080.stdout:CentOS Stream 9 - CRB 11 MB/s | 8.0 MB 00:00 2026-02-24T18:16:16.073 INFO:teuthology.orchestra.run.trial052.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 8.0 MB 00:00 2026-02-24T18:16:17.842 INFO:teuthology.orchestra.run.trial052.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-24T18:16:17.859 INFO:teuthology.orchestra.run.trial080.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-24T18:16:18.348 INFO:teuthology.orchestra.run.trial052.stdout:Extra Packages for Enterprise Linux 46 MB/s | 20 MB 00:00 2026-02-24T18:16:19.317 INFO:teuthology.orchestra.run.trial080.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2026-02-24T18:16:21.544 INFO:teuthology.orchestra.run.trial052.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-24T18:16:22.581 INFO:teuthology.orchestra.run.trial080.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-24T18:16:22.768 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: Package Arch Version Repository Size 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout:Upgrading: 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout:Installing dependencies: 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:16:22.769 INFO:teuthology.orchestra.run.trial052.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout:Installing weak dependencies: 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout:Install 32 Packages 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout:Upgrade 2 Packages 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 62 M 2026-02-24T18:16:22.770 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:16:23.585 INFO:teuthology.orchestra.run.trial052.stdout:(1/34): ceph-base-19.2.3-689.gf90f4eae.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-24T18:16:23.817 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: Package Arch Version Repository Size 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout:Upgrading: 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout:Installing dependencies: 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:16:23.818 INFO:teuthology.orchestra.run.trial080.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout:Installing weak dependencies: 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout:Install 32 Packages 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout:Upgrade 2 Packages 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 62 M 2026-02-24T18:16:23.819 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:16:23.899 INFO:teuthology.orchestra.run.trial052.stdout:(2/34): ceph-selinux-19.2.3-689.gf90f4eae.el9.x 80 kB/s | 25 kB 00:00 2026-02-24T18:16:24.004 INFO:teuthology.orchestra.run.trial052.stdout:(3/34): ceph-radosgw-19.2.3-689.gf90f4eae.el9.x 14 MB/s | 11 MB 00:00 2026-02-24T18:16:24.056 INFO:teuthology.orchestra.run.trial052.stdout:(4/34): libcephfs2-19.2.3-689.gf90f4eae.el9.x86 6.2 MB/s | 999 kB 00:00 2026-02-24T18:16:24.103 INFO:teuthology.orchestra.run.trial052.stdout:(5/34): libradosstriper1-19.2.3-689.gf90f4eae.e 5.0 MB/s | 503 kB 00:00 2026-02-24T18:16:24.183 INFO:teuthology.orchestra.run.trial052.stdout:(6/34): python3-ceph-argparse-19.2.3-689.gf90f4 563 kB/s | 45 kB 00:00 2026-02-24T18:16:24.283 INFO:teuthology.orchestra.run.trial052.stdout:(7/34): python3-ceph-common-19.2.3-689.gf90f4ea 1.4 MB/s | 142 kB 00:00 2026-02-24T18:16:24.362 INFO:teuthology.orchestra.run.trial052.stdout:(8/34): python3-cephfs-19.2.3-689.gf90f4eae.el9 2.0 MB/s | 165 kB 00:00 2026-02-24T18:16:24.481 INFO:teuthology.orchestra.run.trial052.stdout:(9/34): python3-rados-19.2.3-689.gf90f4eae.el9. 2.7 MB/s | 322 kB 00:00 2026-02-24T18:16:24.638 INFO:teuthology.orchestra.run.trial052.stdout:(10/34): python3-rbd-19.2.3-689.gf90f4eae.el9.x 1.9 MB/s | 303 kB 00:00 2026-02-24T18:16:24.740 INFO:teuthology.orchestra.run.trial080.stdout:(1/34): ceph-base-19.2.3-689.gf90f4eae.el9.x86_ 13 MB/s | 5.5 MB 00:00 2026-02-24T18:16:24.783 INFO:teuthology.orchestra.run.trial052.stdout:(11/34): python3-rgw-19.2.3-689.gf90f4eae.el9.x 688 kB/s | 100 kB 00:00 2026-02-24T18:16:25.050 INFO:teuthology.orchestra.run.trial052.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 124 kB/s | 33 kB 00:00 2026-02-24T18:16:25.173 INFO:teuthology.orchestra.run.trial052.stdout:(13/34): librgw2-19.2.3-689.gf90f4eae.el9.x86_6 4.8 MB/s | 5.4 MB 00:01 2026-02-24T18:16:25.204 INFO:teuthology.orchestra.run.trial080.stdout:(2/34): ceph-selinux-19.2.3-689.gf90f4eae.el9.x 54 kB/s | 25 kB 00:00 2026-02-24T18:16:25.277 INFO:teuthology.orchestra.run.trial052.stdout:(14/34): pciutils-3.7.0-7.el9.x86_64.rpm 410 kB/s | 93 kB 00:00 2026-02-24T18:16:25.452 INFO:teuthology.orchestra.run.trial052.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 939 kB/s | 164 kB 00:00 2026-02-24T18:16:25.458 INFO:teuthology.orchestra.run.trial080.stdout:(3/34): libcephfs2-19.2.3-689.gf90f4eae.el9.x86 3.8 MB/s | 999 kB 00:00 2026-02-24T18:16:25.523 INFO:teuthology.orchestra.run.trial080.stdout:(4/34): libradosstriper1-19.2.3-689.gf90f4eae.e 7.5 MB/s | 503 kB 00:00 2026-02-24T18:16:25.563 INFO:teuthology.orchestra.run.trial052.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2026-02-24T18:16:25.569 INFO:teuthology.orchestra.run.trial052.stdout:(17/34): boost-program-options-1.75.0-13.el9.x8 263 kB/s | 104 kB 00:00 2026-02-24T18:16:25.649 INFO:teuthology.orchestra.run.trial052.stdout:(18/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 526 kB/s | 45 kB 00:00 2026-02-24T18:16:25.787 INFO:teuthology.orchestra.run.trial052.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2026-02-24T18:16:25.884 INFO:teuthology.orchestra.run.trial052.stdout:(20/34): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2026-02-24T18:16:25.904 INFO:teuthology.orchestra.run.trial052.stdout:(21/34): qatlib-25.08.0-2.el9.x86_64.rpm 2.0 MB/s | 240 kB 00:00 2026-02-24T18:16:25.913 INFO:teuthology.orchestra.run.trial080.stdout:(5/34): ceph-common-19.2.3-689.gf90f4eae.el9.x8 14 MB/s | 22 MB 00:01 2026-02-24T18:16:25.939 INFO:teuthology.orchestra.run.trial080.stdout:(6/34): python3-ceph-argparse-19.2.3-689.gf90f4 1.7 MB/s | 45 kB 00:00 2026-02-24T18:16:25.955 INFO:teuthology.orchestra.run.trial052.stdout:(22/34): ceph-common-19.2.3-689.gf90f4eae.el9.x 8.0 MB/s | 22 MB 00:02 2026-02-24T18:16:25.963 INFO:teuthology.orchestra.run.trial052.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 467 kB/s | 37 kB 00:00 2026-02-24T18:16:25.978 INFO:teuthology.orchestra.run.trial080.stdout:(7/34): python3-ceph-common-19.2.3-689.gf90f4ea 3.6 MB/s | 142 kB 00:00 2026-02-24T18:16:25.991 INFO:teuthology.orchestra.run.trial052.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 761 kB/s | 66 kB 00:00 2026-02-24T18:16:26.021 INFO:teuthology.orchestra.run.trial080.stdout:(8/34): ceph-radosgw-19.2.3-689.gf90f4eae.el9.x 6.2 MB/s | 11 MB 00:01 2026-02-24T18:16:26.022 INFO:teuthology.orchestra.run.trial080.stdout:(9/34): python3-cephfs-19.2.3-689.gf90f4eae.el9 3.7 MB/s | 165 kB 00:00 2026-02-24T18:16:26.057 INFO:teuthology.orchestra.run.trial080.stdout:(10/34): python3-rados-19.2.3-689.gf90f4eae.el9 8.9 MB/s | 322 kB 00:00 2026-02-24T18:16:26.062 INFO:teuthology.orchestra.run.trial080.stdout:(11/34): python3-rbd-19.2.3-689.gf90f4eae.el9.x 7.3 MB/s | 303 kB 00:00 2026-02-24T18:16:26.092 INFO:teuthology.orchestra.run.trial080.stdout:(12/34): python3-rgw-19.2.3-689.gf90f4eae.el9.x 2.8 MB/s | 100 kB 00:00 2026-02-24T18:16:26.150 INFO:teuthology.orchestra.run.trial080.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 379 kB/s | 33 kB 00:00 2026-02-24T18:16:26.167 INFO:teuthology.orchestra.run.trial052.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 140 kB/s | 25 kB 00:00 2026-02-24T18:16:26.176 INFO:teuthology.orchestra.run.trial080.stdout:(14/34): librgw2-19.2.3-689.gf90f4eae.el9.x86_6 8.3 MB/s | 5.4 MB 00:00 2026-02-24T18:16:26.190 INFO:teuthology.orchestra.run.trial080.stdout:(15/34): boost-program-options-1.75.0-13.el9.x8 2.5 MB/s | 104 kB 00:00 2026-02-24T18:16:26.208 INFO:teuthology.orchestra.run.trial080.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 9.0 MB/s | 160 kB 00:00 2026-02-24T18:16:26.213 INFO:teuthology.orchestra.run.trial080.stdout:(17/34): pciutils-3.7.0-7.el9.x86_64.rpm 770 kB/s | 93 kB 00:00 2026-02-24T18:16:26.217 INFO:teuthology.orchestra.run.trial080.stdout:(18/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.9 MB/s | 45 kB 00:00 2026-02-24T18:16:26.219 INFO:teuthology.orchestra.run.trial080.stdout:(19/34): libnbd-1.20.3-4.el9.x86_64.rpm 3.7 MB/s | 164 kB 00:00 2026-02-24T18:16:26.236 INFO:teuthology.orchestra.run.trial080.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 16 MB/s | 292 kB 00:00 2026-02-24T18:16:26.238 INFO:teuthology.orchestra.run.trial080.stdout:(21/34): qatlib-25.08.0-2.el9.x86_64.rpm 13 MB/s | 240 kB 00:00 2026-02-24T18:16:26.244 INFO:teuthology.orchestra.run.trial080.stdout:(22/34): qatlib-service-25.08.0-2.el9.x86_64.rp 4.1 MB/s | 37 kB 00:00 2026-02-24T18:16:26.247 INFO:teuthology.orchestra.run.trial080.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.0 MB/s | 66 kB 00:00 2026-02-24T18:16:26.250 INFO:teuthology.orchestra.run.trial052.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 592 kB/s | 49 kB 00:00 2026-02-24T18:16:26.272 INFO:teuthology.orchestra.run.trial080.stdout:(24/34): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2026-02-24T18:16:26.284 INFO:teuthology.orchestra.run.trial052.stdout:(27/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 934 kB/s | 308 kB 00:00 2026-02-24T18:16:26.301 INFO:teuthology.orchestra.run.trial080.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 845 kB/s | 25 kB 00:00 2026-02-24T18:16:26.305 INFO:teuthology.orchestra.run.trial080.stdout:(26/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.9 MB/s | 308 kB 00:00 2026-02-24T18:16:26.312 INFO:teuthology.orchestra.run.trial052.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2026-02-24T18:16:26.316 INFO:teuthology.orchestra.run.trial080.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 6.6 MB/s | 67 kB 00:00 2026-02-24T18:16:26.334 INFO:teuthology.orchestra.run.trial080.stdout:(28/34): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-24T18:16:26.344 INFO:teuthology.orchestra.run.trial080.stdout:(29/34): libarrow-9.0.0-15.el9.x86_64.rpm 46 MB/s | 4.4 MB 00:00 2026-02-24T18:16:26.345 INFO:teuthology.orchestra.run.trial080.stdout:(30/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 28 MB/s | 838 kB 00:00 2026-02-24T18:16:26.363 INFO:teuthology.orchestra.run.trial080.stdout:(31/34): re2-20211101-20.el9.x86_64.rpm 6.5 MB/s | 191 kB 00:00 2026-02-24T18:16:26.372 INFO:teuthology.orchestra.run.trial080.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 55 MB/s | 1.6 MB 00:00 2026-02-24T18:16:26.410 INFO:teuthology.orchestra.run.trial052.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 6.6 MB/s | 838 kB 00:00 2026-02-24T18:16:26.412 INFO:teuthology.orchestra.run.trial052.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2026-02-24T18:16:26.449 INFO:teuthology.orchestra.run.trial052.stdout:(31/34): libarrow-9.0.0-15.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2026-02-24T18:16:26.509 INFO:teuthology.orchestra.run.trial052.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2026-02-24T18:16:26.918 INFO:teuthology.orchestra.run.trial052.stdout:(33/34): librados2-19.2.3-689.gf90f4eae.el9.x86 6.8 MB/s | 3.4 MB 00:00 2026-02-24T18:16:26.919 INFO:teuthology.orchestra.run.trial080.stdout:(33/34): librados2-19.2.3-689.gf90f4eae.el9.x86 6.0 MB/s | 3.4 MB 00:00 2026-02-24T18:16:27.400 INFO:teuthology.orchestra.run.trial080.stdout:(34/34): librbd1-19.2.3-689.gf90f4eae.el9.x86_6 3.1 MB/s | 3.2 MB 00:01 2026-02-24T18:16:27.402 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:27.402 INFO:teuthology.orchestra.run.trial080.stdout:Total 17 MB/s | 62 MB 00:03 2026-02-24T18:16:27.498 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:16:27.515 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:16:27.515 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:16:27.532 INFO:teuthology.orchestra.run.trial052.stdout:(34/34): librbd1-19.2.3-689.gf90f4eae.el9.x86_6 2.9 MB/s | 3.2 MB 00:01 2026-02-24T18:16:27.534 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:27.535 INFO:teuthology.orchestra.run.trial052.stdout:Total 13 MB/s | 62 MB 00:04 2026-02-24T18:16:27.627 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:16:27.644 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:16:27.644 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:16:27.743 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:16:27.743 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:16:27.872 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:16:27.872 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:16:28.029 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:16:28.038 INFO:teuthology.orchestra.run.trial080.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-24T18:16:28.041 INFO:teuthology.orchestra.run.trial080.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-24T18:16:28.052 INFO:teuthology.orchestra.run.trial080.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-24T18:16:28.158 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:16:28.168 INFO:teuthology.orchestra.run.trial052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-24T18:16:28.171 INFO:teuthology.orchestra.run.trial052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-24T18:16:28.182 INFO:teuthology.orchestra.run.trial052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-24T18:16:28.202 INFO:teuthology.orchestra.run.trial080.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-24T18:16:28.206 INFO:teuthology.orchestra.run.trial080.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/36 2026-02-24T18:16:28.237 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/36 2026-02-24T18:16:28.281 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/36 2026-02-24T18:16:28.282 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/36 2026-02-24T18:16:28.294 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/36 2026-02-24T18:16:28.299 INFO:teuthology.orchestra.run.trial080.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-24T18:16:28.308 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 9/36 2026-02-24T18:16:28.332 INFO:teuthology.orchestra.run.trial052.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-24T18:16:28.333 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/36 2026-02-24T18:16:28.334 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/36 2026-02-24T18:16:28.337 INFO:teuthology.orchestra.run.trial052.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/36 2026-02-24T18:16:28.349 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/36 2026-02-24T18:16:28.367 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/36 2026-02-24T18:16:28.380 INFO:teuthology.orchestra.run.trial080.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-24T18:16:28.384 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-24T18:16:28.390 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-24T18:16:28.393 INFO:teuthology.orchestra.run.trial080.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-24T18:16:28.396 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-24T18:16:28.400 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-24T18:16:28.411 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/36 2026-02-24T18:16:28.412 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/36 2026-02-24T18:16:28.425 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/36 2026-02-24T18:16:28.429 INFO:teuthology.orchestra.run.trial052.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-24T18:16:28.440 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 9/36 2026-02-24T18:16:28.463 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/36 2026-02-24T18:16:28.464 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/36 2026-02-24T18:16:28.478 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/36 2026-02-24T18:16:28.513 INFO:teuthology.orchestra.run.trial052.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-24T18:16:28.517 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-24T18:16:28.523 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-24T18:16:28.525 INFO:teuthology.orchestra.run.trial052.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-24T18:16:28.528 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-24T18:16:28.533 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-24T18:16:28.539 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:16:28.540 INFO:teuthology.orchestra.run.trial080.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/36 2026-02-24T18:16:28.566 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/36 2026-02-24T18:16:28.568 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 20/36 2026-02-24T18:16:28.574 INFO:teuthology.orchestra.run.trial080.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:16:28.672 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:16:28.673 INFO:teuthology.orchestra.run.trial052.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/36 2026-02-24T18:16:28.699 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/36 2026-02-24T18:16:28.701 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 20/36 2026-02-24T18:16:28.707 INFO:teuthology.orchestra.run.trial052.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:16:28.800 INFO:teuthology.orchestra.run.trial080.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:16:28.801 INFO:teuthology.orchestra.run.trial080.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/36 2026-02-24T18:16:28.817 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/36 2026-02-24T18:16:28.821 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/36 2026-02-24T18:16:28.825 INFO:teuthology.orchestra.run.trial080.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:16:28.828 INFO:teuthology.orchestra.run.trial080.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:16:28.828 INFO:teuthology.orchestra.run.trial080.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:16:28.846 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:16:28.849 INFO:teuthology.orchestra.run.trial080.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:16:28.876 INFO:teuthology.orchestra.run.trial080.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:16:28.877 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 30/36 2026-02-24T18:16:28.932 INFO:teuthology.orchestra.run.trial052.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:16:28.934 INFO:teuthology.orchestra.run.trial052.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/36 2026-02-24T18:16:28.949 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/36 2026-02-24T18:16:28.953 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/36 2026-02-24T18:16:28.957 INFO:teuthology.orchestra.run.trial052.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:16:28.959 INFO:teuthology.orchestra.run.trial052.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:16:28.960 INFO:teuthology.orchestra.run.trial052.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:16:28.976 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:16:28.979 INFO:teuthology.orchestra.run.trial052.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:16:29.004 INFO:teuthology.orchestra.run.trial052.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:16:29.005 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 30/36 2026-02-24T18:16:29.852 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 31/36 2026-02-24T18:16:29.855 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 31/36 2026-02-24T18:16:29.982 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 31/36 2026-02-24T18:16:29.984 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 31/36 2026-02-24T18:16:30.135 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 31/36 2026-02-24T18:16:30.138 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 32/36 2026-02-24T18:16:30.183 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 32/36 2026-02-24T18:16:30.183 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:16:30.184 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:16:30.184 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:30.188 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 33/36 2026-02-24T18:16:30.266 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 31/36 2026-02-24T18:16:30.269 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 32/36 2026-02-24T18:16:30.313 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 32/36 2026-02-24T18:16:30.314 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:16:30.314 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:16:30.314 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:30.317 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 33/36 2026-02-24T18:16:34.712 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 33/36 2026-02-24T18:16:34.712 INFO:teuthology.orchestra.run.trial080.stdout:skipping the directory /sys 2026-02-24T18:16:34.713 INFO:teuthology.orchestra.run.trial080.stdout:skipping the directory /proc 2026-02-24T18:16:34.713 INFO:teuthology.orchestra.run.trial080.stdout:skipping the directory /mnt 2026-02-24T18:16:34.713 INFO:teuthology.orchestra.run.trial080.stdout:skipping the directory /var/tmp 2026-02-24T18:16:34.713 INFO:teuthology.orchestra.run.trial080.stdout:skipping the directory /home 2026-02-24T18:16:34.713 INFO:teuthology.orchestra.run.trial080.stdout:skipping the directory /root 2026-02-24T18:16:34.713 INFO:teuthology.orchestra.run.trial080.stdout:skipping the directory /tmp 2026-02-24T18:16:34.713 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:34.786 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 33/36 2026-02-24T18:16:34.786 INFO:teuthology.orchestra.run.trial052.stdout:skipping the directory /sys 2026-02-24T18:16:34.786 INFO:teuthology.orchestra.run.trial052.stdout:skipping the directory /proc 2026-02-24T18:16:34.786 INFO:teuthology.orchestra.run.trial052.stdout:skipping the directory /mnt 2026-02-24T18:16:34.786 INFO:teuthology.orchestra.run.trial052.stdout:skipping the directory /var/tmp 2026-02-24T18:16:34.786 INFO:teuthology.orchestra.run.trial052.stdout:skipping the directory /home 2026-02-24T18:16:34.786 INFO:teuthology.orchestra.run.trial052.stdout:skipping the directory /root 2026-02-24T18:16:34.787 INFO:teuthology.orchestra.run.trial052.stdout:skipping the directory /tmp 2026-02-24T18:16:34.787 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:35.165 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 34/36 2026-02-24T18:16:35.189 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 34/36 2026-02-24T18:16:35.189 INFO:teuthology.orchestra.run.trial080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:35.189 INFO:teuthology.orchestra.run.trial080.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:16:35.189 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:16:35.189 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:16:35.189 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:35.191 INFO:teuthology.orchestra.run.trial080.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:16:35.204 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:16:35.204 INFO:teuthology.orchestra.run.trial080.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:16:35.233 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 34/36 2026-02-24T18:16:35.257 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 34/36 2026-02-24T18:16:35.257 INFO:teuthology.orchestra.run.trial052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:35.257 INFO:teuthology.orchestra.run.trial052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:16:35.258 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:16:35.258 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:16:35.258 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:35.260 INFO:teuthology.orchestra.run.trial052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:16:35.261 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:16:35.261 INFO:teuthology.orchestra.run.trial080.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:16:35.261 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:35.272 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:16:35.272 INFO:teuthology.orchestra.run.trial052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:16:35.329 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:16:35.329 INFO:teuthology.orchestra.run.trial052.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:16:35.329 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 1/36 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2/36 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 3/36 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 4/36 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/36 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 6/36 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/36 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 8/36 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 9/36 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/36 2026-02-24T18:16:35.549 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 11/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 12/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 13/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 33/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:16:35.550 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 35/36 2026-02-24T18:16:35.604 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 1/36 2026-02-24T18:16:35.604 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2/36 2026-02-24T18:16:35.604 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 3/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 4/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 6/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 8/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 9/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 11/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 12/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 13/36 2026-02-24T18:16:35.605 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:16:35.606 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:16:35.607 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:16:35.607 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:16:35.607 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:16:35.607 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:16:35.607 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:16:35.607 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:16:35.607 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 33/36 2026-02-24T18:16:35.607 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:16:35.607 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 35/36 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout:Upgraded: 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:16:35.615 INFO:teuthology.orchestra.run.trial080.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:35.616 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:35.657 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-test 2026-02-24T18:16:35.674 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:16:35.674 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:35.674 INFO:teuthology.orchestra.run.trial052.stdout:Upgraded: 2026-02-24T18:16:35.674 INFO:teuthology.orchestra.run.trial052.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.674 INFO:teuthology.orchestra.run.trial052.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.674 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:16:35.674 INFO:teuthology.orchestra.run.trial052.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.675 INFO:teuthology.orchestra.run.trial052.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:35.676 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:35.716 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-test 2026-02-24T18:16:35.973 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:13 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:36.030 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:15 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:36.056 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout: Package Arch Version Repository Size 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout:Installing dependencies: 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout:Install 5 Packages 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 50 M 2026-02-24T18:16:36.057 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 212 M 2026-02-24T18:16:36.058 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:16:36.113 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:36.114 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:36.114 INFO:teuthology.orchestra.run.trial052.stdout: Package Arch Version Repository Size 2026-02-24T18:16:36.114 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:36.114 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:16:36.114 INFO:teuthology.orchestra.run.trial052.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-24T18:16:36.114 INFO:teuthology.orchestra.run.trial052.stdout:Installing dependencies: 2026-02-24T18:16:36.114 INFO:teuthology.orchestra.run.trial052.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout:Install 5 Packages 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 50 M 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 212 M 2026-02-24T18:16:36.115 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:16:36.196 INFO:teuthology.orchestra.run.trial052.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 11 MB/s | 233 kB 00:00 2026-02-24T18:16:36.212 INFO:teuthology.orchestra.run.trial052.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 19 MB/s | 303 kB 00:00 2026-02-24T18:16:36.216 INFO:teuthology.orchestra.run.trial052.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-24T18:16:36.227 INFO:teuthology.orchestra.run.trial080.stdout:(1/5): libcephsqlite-19.2.3-689.gf90f4eae.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-24T18:16:36.259 INFO:teuthology.orchestra.run.trial052.stdout:(4/5): libcephsqlite-19.2.3-689.gf90f4eae.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-24T18:16:36.902 INFO:teuthology.orchestra.run.trial080.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 307 kB/s | 233 kB 00:00 2026-02-24T18:16:37.022 INFO:teuthology.orchestra.run.trial080.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 382 kB/s | 303 kB 00:00 2026-02-24T18:16:37.520 INFO:teuthology.orchestra.run.trial080.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2026-02-24T18:16:38.211 INFO:teuthology.orchestra.run.trial080.stdout:(5/5): ceph-test-19.2.3-689.gf90f4eae.el9.x86_6 24 MB/s | 50 MB 00:02 2026-02-24T18:16:38.212 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:38.212 INFO:teuthology.orchestra.run.trial080.stdout:Total 23 MB/s | 50 MB 00:02 2026-02-24T18:16:38.239 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:16:38.249 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:16:38.249 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:16:38.435 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:16:38.435 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:16:38.648 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:16:38.654 INFO:teuthology.orchestra.run.trial080.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:16:38.658 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:16:38.666 INFO:teuthology.orchestra.run.trial080.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:16:38.667 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-24T18:16:39.662 INFO:teuthology.orchestra.run.trial052.stdout:(5/5): ceph-test-19.2.3-689.gf90f4eae.el9.x86_6 14 MB/s | 50 MB 00:03 2026-02-24T18:16:39.663 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:39.663 INFO:teuthology.orchestra.run.trial052.stdout:Total 14 MB/s | 50 MB 00:03 2026-02-24T18:16:39.689 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:16:39.699 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:16:39.699 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:16:39.885 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:16:39.885 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:16:40.099 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:16:40.104 INFO:teuthology.orchestra.run.trial052.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:16:40.108 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:16:40.116 INFO:teuthology.orchestra.run.trial052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:16:40.117 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-24T18:16:40.958 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-24T18:16:40.977 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-24T18:16:41.212 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-24T18:16:41.212 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 1/5 2026-02-24T18:16:41.212 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2/5 2026-02-24T18:16:41.212 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:16:41.213 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:16:41.274 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:16:41.275 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:41.275 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:16:41.275 INFO:teuthology.orchestra.run.trial080.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:41.275 INFO:teuthology.orchestra.run.trial080.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:41.275 INFO:teuthology.orchestra.run.trial080.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:16:41.275 INFO:teuthology.orchestra.run.trial080.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:16:41.275 INFO:teuthology.orchestra.run.trial080.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:16:41.275 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:41.275 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:41.309 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph 2026-02-24T18:16:41.623 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:19 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:41.710 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout:====================================================================================== 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: Package Arch Version Repository Size 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout:====================================================================================== 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout:Installing dependencies: 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:16:41.713 INFO:teuthology.orchestra.run.trial080.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T18:16:41.714 INFO:teuthology.orchestra.run.trial080.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:16:41.715 INFO:teuthology.orchestra.run.trial080.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T18:16:41.716 INFO:teuthology.orchestra.run.trial080.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout:Installing weak dependencies: 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:41.717 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:16:41.718 INFO:teuthology.orchestra.run.trial080.stdout:====================================================================================== 2026-02-24T18:16:41.718 INFO:teuthology.orchestra.run.trial080.stdout:Install 98 Packages 2026-02-24T18:16:41.718 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:41.719 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 95 M 2026-02-24T18:16:41.719 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 519 M 2026-02-24T18:16:41.719 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:16:42.247 INFO:teuthology.orchestra.run.trial080.stdout:(1/98): ceph-19.2.3-689.gf90f4eae.el9.x86_64.rp 129 kB/s | 6.5 kB 00:00 2026-02-24T18:16:42.350 INFO:teuthology.orchestra.run.trial080.stdout:(2/98): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_6 16 MB/s | 2.4 MB 00:00 2026-02-24T18:16:42.410 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-24T18:16:42.428 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-24T18:16:42.670 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-24T18:16:42.670 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 1/5 2026-02-24T18:16:42.670 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2/5 2026-02-24T18:16:42.670 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:16:42.670 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:16:42.698 INFO:teuthology.orchestra.run.trial080.stdout:(3/98): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_6 2.1 MB/s | 1.1 MB 00:00 2026-02-24T18:16:42.728 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:16:42.728 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:42.728 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:16:42.728 INFO:teuthology.orchestra.run.trial052.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:42.728 INFO:teuthology.orchestra.run.trial052.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:42.728 INFO:teuthology.orchestra.run.trial052.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:16:42.728 INFO:teuthology.orchestra.run.trial052.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:16:42.728 INFO:teuthology.orchestra.run.trial052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:16:42.728 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:42.728 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:42.763 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph 2026-02-24T18:16:42.790 INFO:teuthology.orchestra.run.trial080.stdout:(4/98): ceph-osd-19.2.3-689.gf90f4eae.el9.x86_6 39 MB/s | 17 MB 00:00 2026-02-24T18:16:42.791 INFO:teuthology.orchestra.run.trial080.stdout:(5/98): ceph-grafana-dashboards-19.2.3-689.gf90 335 kB/s | 31 kB 00:00 2026-02-24T18:16:43.082 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:22 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:43.171 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:43.174 INFO:teuthology.orchestra.run.trial052.stdout:====================================================================================== 2026-02-24T18:16:43.174 INFO:teuthology.orchestra.run.trial052.stdout: Package Arch Version Repository Size 2026-02-24T18:16:43.174 INFO:teuthology.orchestra.run.trial052.stdout:====================================================================================== 2026-02-24T18:16:43.175 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:16:43.175 INFO:teuthology.orchestra.run.trial052.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-24T18:16:43.175 INFO:teuthology.orchestra.run.trial052.stdout:Installing dependencies: 2026-02-24T18:16:43.175 INFO:teuthology.orchestra.run.trial052.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:16:43.175 INFO:teuthology.orchestra.run.trial052.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-24T18:16:43.175 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-24T18:16:43.175 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-24T18:16:43.175 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-24T18:16:43.175 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-24T18:16:43.175 INFO:teuthology.orchestra.run.trial052.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:16:43.176 INFO:teuthology.orchestra.run.trial052.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:16:43.177 INFO:teuthology.orchestra.run.trial052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:16:43.178 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:16:43.179 INFO:teuthology.orchestra.run.trial052.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:16:43.180 INFO:teuthology.orchestra.run.trial052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:16:43.181 INFO:teuthology.orchestra.run.trial052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout:Installing weak dependencies: 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-24T18:16:43.182 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-24T18:16:43.183 INFO:teuthology.orchestra.run.trial052.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-24T18:16:43.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T18:16:43.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T18:16:43.183 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:43.183 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:16:43.183 INFO:teuthology.orchestra.run.trial052.stdout:====================================================================================== 2026-02-24T18:16:43.183 INFO:teuthology.orchestra.run.trial052.stdout:Install 98 Packages 2026-02-24T18:16:43.183 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:43.184 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 95 M 2026-02-24T18:16:43.184 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 519 M 2026-02-24T18:16:43.184 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:16:43.225 INFO:teuthology.orchestra.run.trial080.stdout:(6/98): ceph-mgr-cephadm-19.2.3-689.gf90f4eae.e 346 kB/s | 150 kB 00:00 2026-02-24T18:16:43.435 INFO:teuthology.orchestra.run.trial080.stdout:(7/98): ceph-mgr-diskprediction-local-19.2.3-68 35 MB/s | 7.4 MB 00:00 2026-02-24T18:16:43.449 INFO:teuthology.orchestra.run.trial080.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-689.gf90f4eae 1.5 MB/s | 22 kB 00:00 2026-02-24T18:16:43.469 INFO:teuthology.orchestra.run.trial080.stdout:(9/98): ceph-mgr-modules-core-19.2.3-689.gf90f4 13 MB/s | 253 kB 00:00 2026-02-24T18:16:43.485 INFO:teuthology.orchestra.run.trial080.stdout:(10/98): ceph-mgr-rook-19.2.3-689.gf90f4eae.el9 3.0 MB/s | 49 kB 00:00 2026-02-24T18:16:43.501 INFO:teuthology.orchestra.run.trial080.stdout:(11/98): ceph-prometheus-alerts-19.2.3-689.gf90 1.0 MB/s | 17 kB 00:00 2026-02-24T18:16:43.523 INFO:teuthology.orchestra.run.trial080.stdout:(12/98): ceph-volume-19.2.3-689.gf90f4eae.el9.n 14 MB/s | 299 kB 00:00 2026-02-24T18:16:43.554 INFO:teuthology.orchestra.run.trial080.stdout:(13/98): cephadm-19.2.3-689.gf90f4eae.el9.noarc 24 MB/s | 769 kB 00:00 2026-02-24T18:16:43.575 INFO:teuthology.orchestra.run.trial080.stdout:(14/98): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_ 3.6 MB/s | 4.7 MB 00:01 2026-02-24T18:16:43.662 INFO:teuthology.orchestra.run.trial080.stdout:(15/98): ceph-mgr-dashboard-19.2.3-689.gf90f4ea 4.4 MB/s | 3.8 MB 00:00 2026-02-24T18:16:43.771 INFO:teuthology.orchestra.run.trial052.stdout:(1/98): ceph-19.2.3-689.gf90f4eae.el9.x86_64.rp 124 kB/s | 6.5 kB 00:00 2026-02-24T18:16:43.865 INFO:teuthology.orchestra.run.trial052.stdout:(2/98): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_6 7.4 MB/s | 1.1 MB 00:00 2026-02-24T18:16:43.893 INFO:teuthology.orchestra.run.trial052.stdout:(3/98): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-24T18:16:43.930 INFO:teuthology.orchestra.run.trial052.stdout:(4/98): ceph-grafana-dashboards-19.2.3-689.gf90 828 kB/s | 31 kB 00:00 2026-02-24T18:16:43.979 INFO:teuthology.orchestra.run.trial052.stdout:(5/98): ceph-mgr-cephadm-19.2.3-689.gf90f4eae.e 3.1 MB/s | 150 kB 00:00 2026-02-24T18:16:44.010 INFO:teuthology.orchestra.run.trial052.stdout:(6/98): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_6 20 MB/s | 4.7 MB 00:00 2026-02-24T18:16:44.011 INFO:teuthology.orchestra.run.trial080.stdout:(16/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 93 kB/s | 40 kB 00:00 2026-02-24T18:16:44.217 INFO:teuthology.orchestra.run.trial052.stdout:(7/98): ceph-mgr-dashboard-19.2.3-689.gf90f4eae 16 MB/s | 3.8 MB 00:00 2026-02-24T18:16:44.233 INFO:teuthology.orchestra.run.trial080.stdout:(17/98): libconfig-1.7.2-9.el9.x86_64.rpm 126 kB/s | 72 kB 00:00 2026-02-24T18:16:44.255 INFO:teuthology.orchestra.run.trial052.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-689.gf90f4eae 593 kB/s | 22 kB 00:00 2026-02-24T18:16:44.297 INFO:teuthology.orchestra.run.trial052.stdout:(9/98): ceph-mgr-modules-core-19.2.3-689.gf90f4 5.9 MB/s | 253 kB 00:00 2026-02-24T18:16:44.335 INFO:teuthology.orchestra.run.trial052.stdout:(10/98): ceph-mgr-rook-19.2.3-689.gf90f4eae.el9 1.3 MB/s | 49 kB 00:00 2026-02-24T18:16:44.360 INFO:teuthology.orchestra.run.trial052.stdout:(11/98): ceph-mgr-diskprediction-local-19.2.3-6 21 MB/s | 7.4 MB 00:00 2026-02-24T18:16:44.360 INFO:teuthology.orchestra.run.trial052.stdout:(12/98): ceph-prometheus-alerts-19.2.3-689.gf90 667 kB/s | 17 kB 00:00 2026-02-24T18:16:44.386 INFO:teuthology.orchestra.run.trial052.stdout:(13/98): ceph-volume-19.2.3-689.gf90f4eae.el9.n 11 MB/s | 299 kB 00:00 2026-02-24T18:16:44.388 INFO:teuthology.orchestra.run.trial080.stdout:(18/98): cryptsetup-2.8.1-3.el9.x86_64.rpm 421 kB/s | 351 kB 00:00 2026-02-24T18:16:44.401 INFO:teuthology.orchestra.run.trial052.stdout:(14/98): cephadm-19.2.3-689.gf90f4eae.el9.noarc 19 MB/s | 769 kB 00:00 2026-02-24T18:16:44.478 INFO:teuthology.orchestra.run.trial052.stdout:(15/98): ceph-osd-19.2.3-689.gf90f4eae.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-24T18:16:44.478 INFO:teuthology.orchestra.run.trial052.stdout:(16/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 521 kB/s | 40 kB 00:00 2026-02-24T18:16:44.587 INFO:teuthology.orchestra.run.trial052.stdout:(17/98): cryptsetup-2.8.1-3.el9.x86_64.rpm 1.7 MB/s | 351 kB 00:00 2026-02-24T18:16:44.588 INFO:teuthology.orchestra.run.trial052.stdout:(18/98): libconfig-1.7.2-9.el9.x86_64.rpm 653 kB/s | 72 kB 00:00 2026-02-24T18:16:44.624 INFO:teuthology.orchestra.run.trial052.stdout:(19/98): libgfortran-11.5.0-14.el9.x86_64.rpm 5.3 MB/s | 794 kB 00:00 2026-02-24T18:16:44.646 INFO:teuthology.orchestra.run.trial052.stdout:(20/98): libquadmath-11.5.0-14.el9.x86_64.rpm 3.1 MB/s | 184 kB 00:00 2026-02-24T18:16:44.652 INFO:teuthology.orchestra.run.trial052.stdout:(21/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.9 MB/s | 253 kB 00:00 2026-02-24T18:16:44.701 INFO:teuthology.orchestra.run.trial052.stdout:(22/98): python3-cryptography-36.0.1-5.el9.x86_ 16 MB/s | 1.2 MB 00:00 2026-02-24T18:16:44.703 INFO:teuthology.orchestra.run.trial052.stdout:(23/98): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2026-02-24T18:16:44.713 INFO:teuthology.orchestra.run.trial052.stdout:(24/98): python3-pycparser-2.20-6.el9.noarch.rp 2.2 MB/s | 135 kB 00:00 2026-02-24T18:16:44.724 INFO:teuthology.orchestra.run.trial080.stdout:(19/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 755 kB/s | 253 kB 00:00 2026-02-24T18:16:44.766 INFO:teuthology.orchestra.run.trial052.stdout:(25/98): python3-urllib3-1.26.5-7.el9.noarch.rp 3.3 MB/s | 218 kB 00:00 2026-02-24T18:16:44.769 INFO:teuthology.orchestra.run.trial052.stdout:(26/98): unzip-6.0-59.el9.x86_64.rpm 3.1 MB/s | 182 kB 00:00 2026-02-24T18:16:44.773 INFO:teuthology.orchestra.run.trial052.stdout:(27/98): python3-requests-2.25.1-10.el9.noarch. 1.7 MB/s | 126 kB 00:00 2026-02-24T18:16:44.816 INFO:teuthology.orchestra.run.trial052.stdout:(28/98): flexiblas-3.0.4-9.el9.x86_64.rpm 638 kB/s | 30 kB 00:00 2026-02-24T18:16:44.837 INFO:teuthology.orchestra.run.trial052.stdout:(29/98): flexiblas-openblas-openmp-3.0.4-9.el9. 692 kB/s | 15 kB 00:00 2026-02-24T18:16:44.845 INFO:teuthology.orchestra.run.trial052.stdout:(30/98): zip-3.0-35.el9.x86_64.rpm 3.3 MB/s | 266 kB 00:00 2026-02-24T18:16:44.882 INFO:teuthology.orchestra.run.trial052.stdout:(31/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 5.4 MB/s | 246 kB 00:00 2026-02-24T18:16:44.904 INFO:teuthology.orchestra.run.trial052.stdout:(32/98): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-24T18:16:44.929 INFO:teuthology.orchestra.run.trial052.stdout:(33/98): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2026-02-24T18:16:44.953 INFO:teuthology.orchestra.run.trial080.stdout:(20/98): libquadmath-11.5.0-14.el9.x86_64.rpm 256 kB/s | 184 kB 00:00 2026-02-24T18:16:44.962 INFO:teuthology.orchestra.run.trial052.stdout:(34/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 16 MB/s | 3.0 MB 00:00 2026-02-24T18:16:45.010 INFO:teuthology.orchestra.run.trial052.stdout:(35/98): protobuf-3.14.0-17.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2026-02-24T18:16:45.034 INFO:teuthology.orchestra.run.trial052.stdout:(36/98): python3-devel-3.9.25-3.el9.x86_64.rpm 9.7 MB/s | 244 kB 00:00 2026-02-24T18:16:45.060 INFO:teuthology.orchestra.run.trial052.stdout:(37/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 9.3 MB/s | 249 kB 00:00 2026-02-24T18:16:45.084 INFO:teuthology.orchestra.run.trial052.stdout:(38/98): python3-libstoragemgmt-1.10.1-1.el9.x8 7.3 MB/s | 177 kB 00:00 2026-02-24T18:16:45.096 INFO:teuthology.orchestra.run.trial052.stdout:(39/98): python3-babel-2.9.1-2.el9.noarch.rpm 45 MB/s | 6.0 MB 00:00 2026-02-24T18:16:45.108 INFO:teuthology.orchestra.run.trial052.stdout:(40/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 26 MB/s | 5.3 MB 00:00 2026-02-24T18:16:45.121 INFO:teuthology.orchestra.run.trial052.stdout:(41/98): python3-mako-1.1.4-6.el9.noarch.rpm 6.9 MB/s | 172 kB 00:00 2026-02-24T18:16:45.130 INFO:teuthology.orchestra.run.trial052.stdout:(42/98): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-24T18:16:45.150 INFO:teuthology.orchestra.run.trial052.stdout:(43/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 19 MB/s | 1.2 MB 00:00 2026-02-24T18:16:45.156 INFO:teuthology.orchestra.run.trial052.stdout:(44/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 17 MB/s | 442 kB 00:00 2026-02-24T18:16:45.173 INFO:teuthology.orchestra.run.trial052.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-24T18:16:45.180 INFO:teuthology.orchestra.run.trial052.stdout:(46/98): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-24T18:16:45.197 INFO:teuthology.orchestra.run.trial052.stdout:(47/98): python3-pyasn1-0.4.8-7.el9.noarch.rpm 6.4 MB/s | 157 kB 00:00 2026-02-24T18:16:45.205 INFO:teuthology.orchestra.run.trial052.stdout:(48/98): python3-pyasn1-modules-0.4.8-7.el9.noa 11 MB/s | 277 kB 00:00 2026-02-24T18:16:45.220 INFO:teuthology.orchestra.run.trial052.stdout:(49/98): python3-requests-oauthlib-1.3.0-12.el9 2.3 MB/s | 54 kB 00:00 2026-02-24T18:16:45.242 INFO:teuthology.orchestra.run.trial052.stdout:(50/98): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-24T18:16:45.254 INFO:teuthology.orchestra.run.trial052.stdout:(51/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 46 MB/s | 6.1 MB 00:00 2026-02-24T18:16:45.265 INFO:teuthology.orchestra.run.trial052.stdout:(52/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.9 MB/s | 189 kB 00:00 2026-02-24T18:16:45.277 INFO:teuthology.orchestra.run.trial052.stdout:(53/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.9 MB/s | 90 kB 00:00 2026-02-24T18:16:45.285 INFO:teuthology.orchestra.run.trial080.stdout:(21/98): python3-ply-3.11-14.el9.noarch.rpm 321 kB/s | 106 kB 00:00 2026-02-24T18:16:45.617 INFO:teuthology.orchestra.run.trial080.stdout:(22/98): python3-pycparser-2.20-6.el9.noarch.rp 407 kB/s | 135 kB 00:00 2026-02-24T18:16:45.797 INFO:teuthology.orchestra.run.trial052.stdout:(54/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 33 MB/s | 19 MB 00:00 2026-02-24T18:16:45.829 INFO:teuthology.orchestra.run.trial052.stdout:(55/98): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2026-02-24T18:16:45.855 INFO:teuthology.orchestra.run.trial052.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 734 kB/s | 19 kB 00:00 2026-02-24T18:16:45.881 INFO:teuthology.orchestra.run.trial052.stdout:(57/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 6.4 MB/s | 551 kB 00:00 2026-02-24T18:16:45.885 INFO:teuthology.orchestra.run.trial052.stdout:(58/98): luarocks-3.9.2-5.el9.noarch.rpm 4.9 MB/s | 151 kB 00:00 2026-02-24T18:16:45.896 INFO:teuthology.orchestra.run.trial052.stdout:(59/98): python3-autocommand-2.2.2-8.el9.noarch 2.8 MB/s | 29 kB 00:00 2026-02-24T18:16:45.898 INFO:teuthology.orchestra.run.trial052.stdout:(60/98): python3-asyncssh-2.13.2-5.el9.noarch.r 32 MB/s | 548 kB 00:00 2026-02-24T18:16:45.902 INFO:teuthology.orchestra.run.trial080.stdout:(23/98): libgfortran-11.5.0-14.el9.x86_64.rpm 420 kB/s | 794 kB 00:01 2026-02-24T18:16:45.907 INFO:teuthology.orchestra.run.trial052.stdout:(61/98): python3-backports-tarfile-1.2.0-1.el9. 5.5 MB/s | 60 kB 00:00 2026-02-24T18:16:45.909 INFO:teuthology.orchestra.run.trial052.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 3.8 MB/s | 43 kB 00:00 2026-02-24T18:16:45.917 INFO:teuthology.orchestra.run.trial052.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 3.1 MB/s | 32 kB 00:00 2026-02-24T18:16:45.934 INFO:teuthology.orchestra.run.trial052.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 595 kB/s | 14 kB 00:00 2026-02-24T18:16:45.938 INFO:teuthology.orchestra.run.trial052.stdout:(65/98): python3-cheroot-10.0.1-4.el9.noarch.rp 8.4 MB/s | 173 kB 00:00 2026-02-24T18:16:45.948 INFO:teuthology.orchestra.run.trial052.stdout:(66/98): python3-cherrypy-18.6.1-2.el9.noarch.r 25 MB/s | 358 kB 00:00 2026-02-24T18:16:45.950 INFO:teuthology.orchestra.run.trial080.stdout:(24/98): python3-requests-2.25.1-10.el9.noarch. 381 kB/s | 126 kB 00:00 2026-02-24T18:16:45.953 INFO:teuthology.orchestra.run.trial052.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 16 MB/s | 254 kB 00:00 2026-02-24T18:16:45.964 INFO:teuthology.orchestra.run.trial052.stdout:(68/98): python3-grpcio-tools-1.46.7-10.el9.x86 12 MB/s | 144 kB 00:00 2026-02-24T18:16:45.977 INFO:teuthology.orchestra.run.trial052.stdout:(69/98): python3-influxdb-5.3.1-1.el9.noarch.rp 11 MB/s | 139 kB 00:00 2026-02-24T18:16:45.987 INFO:teuthology.orchestra.run.trial052.stdout:(70/98): python3-isodate-0.6.1-3.el9.noarch.rpm 5.3 MB/s | 56 kB 00:00 2026-02-24T18:16:45.999 INFO:teuthology.orchestra.run.trial052.stdout:(71/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 40 MB/s | 2.0 MB 00:00 2026-02-24T18:16:45.999 INFO:teuthology.orchestra.run.trial052.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 892 kB/s | 11 kB 00:00 2026-02-24T18:16:46.009 INFO:teuthology.orchestra.run.trial052.stdout:(73/98): python3-jaraco-collections-3.0.0-8.el9 2.3 MB/s | 23 kB 00:00 2026-02-24T18:16:46.010 INFO:teuthology.orchestra.run.trial052.stdout:(74/98): python3-jaraco-classes-3.2.1-5.el9.noa 1.6 MB/s | 18 kB 00:00 2026-02-24T18:16:46.019 INFO:teuthology.orchestra.run.trial052.stdout:(75/98): python3-jaraco-context-6.0.1-3.el9.noa 2.0 MB/s | 20 kB 00:00 2026-02-24T18:16:46.022 INFO:teuthology.orchestra.run.trial052.stdout:(76/98): python3-jaraco-functools-3.5.0-2.el9.n 1.5 MB/s | 19 kB 00:00 2026-02-24T18:16:46.029 INFO:teuthology.orchestra.run.trial052.stdout:(77/98): python3-jaraco-text-4.0.0-2.el9.noarch 2.6 MB/s | 26 kB 00:00 2026-02-24T18:16:46.039 INFO:teuthology.orchestra.run.trial052.stdout:(78/98): python3-kubernetes-26.1.0-3.el9.noarch 60 MB/s | 1.0 MB 00:00 2026-02-24T18:16:46.053 INFO:teuthology.orchestra.run.trial052.stdout:(79/98): python3-logutils-0.3.5-21.el9.noarch.r 1.9 MB/s | 46 kB 00:00 2026-02-24T18:16:46.055 INFO:teuthology.orchestra.run.trial052.stdout:(80/98): python3-more-itertools-8.12.0-2.el9.no 5.0 MB/s | 79 kB 00:00 2026-02-24T18:16:46.064 INFO:teuthology.orchestra.run.trial052.stdout:(81/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 7.8 MB/s | 86 kB 00:00 2026-02-24T18:16:46.066 INFO:teuthology.orchestra.run.trial052.stdout:(82/98): python3-natsort-7.1.1-5.el9.noarch.rpm 5.0 MB/s | 58 kB 00:00 2026-02-24T18:16:46.086 INFO:teuthology.orchestra.run.trial052.stdout:(83/98): python3-portend-3.1.0-2.el9.noarch.rpm 821 kB/s | 16 kB 00:00 2026-02-24T18:16:46.089 INFO:teuthology.orchestra.run.trial052.stdout:(84/98): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2026-02-24T18:16:46.098 INFO:teuthology.orchestra.run.trial052.stdout:(85/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 7.2 MB/s | 90 kB 00:00 2026-02-24T18:16:46.099 INFO:teuthology.orchestra.run.trial052.stdout:(86/98): python3-repoze-lru-0.7-16.el9.noarch.r 3.0 MB/s | 31 kB 00:00 2026-02-24T18:16:46.110 INFO:teuthology.orchestra.run.trial052.stdout:(87/98): python3-rsa-4.9-2.el9.noarch.rpm 5.6 MB/s | 59 kB 00:00 2026-02-24T18:16:46.111 INFO:teuthology.orchestra.run.trial052.stdout:(88/98): python3-routes-2.5.1-5.el9.noarch.rpm 15 MB/s | 188 kB 00:00 2026-02-24T18:16:46.121 INFO:teuthology.orchestra.run.trial052.stdout:(89/98): python3-saml-1.16.0-1.el9.noarch.rpm 10 MB/s | 125 kB 00:00 2026-02-24T18:16:46.122 INFO:teuthology.orchestra.run.trial052.stdout:(90/98): python3-tempora-5.0.0-2.el9.noarch.rpm 3.2 MB/s | 36 kB 00:00 2026-02-24T18:16:46.132 INFO:teuthology.orchestra.run.trial052.stdout:(91/98): python3-typing-extensions-4.15.0-1.el9 7.7 MB/s | 86 kB 00:00 2026-02-24T18:16:46.141 INFO:teuthology.orchestra.run.trial052.stdout:(92/98): python3-webob-1.8.8-2.el9.noarch.rpm 12 MB/s | 230 kB 00:00 2026-02-24T18:16:46.144 INFO:teuthology.orchestra.run.trial052.stdout:(93/98): python3-websocket-client-1.2.3-2.el9.n 7.7 MB/s | 90 kB 00:00 2026-02-24T18:16:46.172 INFO:teuthology.orchestra.run.trial052.stdout:(94/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.7 MB/s | 48 kB 00:00 2026-02-24T18:16:46.174 INFO:teuthology.orchestra.run.trial052.stdout:(95/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 13 MB/s | 427 kB 00:00 2026-02-24T18:16:46.182 INFO:teuthology.orchestra.run.trial052.stdout:(96/98): python3-xmltodict-0.12.0-15.el9.noarch 2.2 MB/s | 22 kB 00:00 2026-02-24T18:16:46.187 INFO:teuthology.orchestra.run.trial052.stdout:(97/98): python3-zc-lockfile-2.0-10.el9.noarch. 1.6 MB/s | 20 kB 00:00 2026-02-24T18:16:46.236 INFO:teuthology.orchestra.run.trial080.stdout:(25/98): python3-urllib3-1.26.5-7.el9.noarch.rp 654 kB/s | 218 kB 00:00 2026-02-24T18:16:46.239 INFO:teuthology.orchestra.run.trial080.stdout:(26/98): python3-cryptography-36.0.1-5.el9.x86_ 842 kB/s | 1.2 MB 00:01 2026-02-24T18:16:46.282 INFO:teuthology.orchestra.run.trial080.stdout:(27/98): unzip-6.0-59.el9.x86_64.rpm 547 kB/s | 182 kB 00:00 2026-02-24T18:16:46.424 INFO:teuthology.orchestra.run.trial080.stdout:(28/98): flexiblas-3.0.4-9.el9.x86_64.rpm 161 kB/s | 30 kB 00:00 2026-02-24T18:16:46.476 INFO:teuthology.orchestra.run.trial080.stdout:(29/98): flexiblas-openblas-openmp-3.0.4-9.el9. 281 kB/s | 15 kB 00:00 2026-02-24T18:16:46.554 INFO:teuthology.orchestra.run.trial080.stdout:(30/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.1 MB/s | 246 kB 00:00 2026-02-24T18:16:46.573 INFO:teuthology.orchestra.run.trial080.stdout:(31/98): zip-3.0-35.el9.x86_64.rpm 788 kB/s | 266 kB 00:00 2026-02-24T18:16:46.578 INFO:teuthology.orchestra.run.trial080.stdout:(32/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 10 MB/s | 3.0 MB 00:00 2026-02-24T18:16:46.611 INFO:teuthology.orchestra.run.trial080.stdout:(33/98): lua-5.4.4-4.el9.x86_64.rpm 3.3 MB/s | 188 kB 00:00 2026-02-24T18:16:46.620 INFO:teuthology.orchestra.run.trial080.stdout:(34/98): openblas-0.3.29-1.el9.x86_64.rpm 892 kB/s | 42 kB 00:00 2026-02-24T18:16:46.659 INFO:teuthology.orchestra.run.trial080.stdout:(35/98): protobuf-3.14.0-17.el9.x86_64.rpm 21 MB/s | 1.0 MB 00:00 2026-02-24T18:16:46.685 INFO:teuthology.orchestra.run.trial080.stdout:(36/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 49 MB/s | 5.3 MB 00:00 2026-02-24T18:16:46.706 INFO:teuthology.orchestra.run.trial080.stdout:(37/98): python3-babel-2.9.1-2.el9.noarch.rpm 69 MB/s | 6.0 MB 00:00 2026-02-24T18:16:46.707 INFO:teuthology.orchestra.run.trial080.stdout:(38/98): python3-devel-3.9.25-3.el9.x86_64.rpm 5.0 MB/s | 244 kB 00:00 2026-02-24T18:16:46.719 INFO:teuthology.orchestra.run.trial080.stdout:(39/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 7.4 MB/s | 249 kB 00:00 2026-02-24T18:16:46.745 INFO:teuthology.orchestra.run.trial080.stdout:(40/98): python3-libstoragemgmt-1.10.1-1.el9.x8 4.5 MB/s | 177 kB 00:00 2026-02-24T18:16:46.752 INFO:teuthology.orchestra.run.trial080.stdout:(41/98): python3-mako-1.1.4-6.el9.noarch.rpm 5.1 MB/s | 172 kB 00:00 2026-02-24T18:16:46.768 INFO:teuthology.orchestra.run.trial080.stdout:(42/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 20 MB/s | 1.2 MB 00:00 2026-02-24T18:16:46.786 INFO:teuthology.orchestra.run.trial080.stdout:(43/98): python3-markupsafe-1.1.1-12.el9.x86_64 848 kB/s | 35 kB 00:00 2026-02-24T18:16:46.813 INFO:teuthology.orchestra.run.trial080.stdout:(44/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 9.6 MB/s | 442 kB 00:00 2026-02-24T18:16:46.816 INFO:teuthology.orchestra.run.trial080.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 2.5 MB/s | 77 kB 00:00 2026-02-24T18:16:46.828 INFO:teuthology.orchestra.run.trial080.stdout:(46/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 82 MB/s | 6.1 MB 00:00 2026-02-24T18:16:46.844 INFO:teuthology.orchestra.run.trial080.stdout:(47/98): python3-protobuf-3.14.0-17.el9.noarch. 8.7 MB/s | 267 kB 00:00 2026-02-24T18:16:46.844 INFO:teuthology.orchestra.run.trial080.stdout:(48/98): python3-pyasn1-0.4.8-7.el9.noarch.rpm 5.5 MB/s | 157 kB 00:00 2026-02-24T18:16:46.859 INFO:teuthology.orchestra.run.trial052.stdout:(98/98): protobuf-compiler-3.14.0-17.el9.x86_64 545 kB/s | 862 kB 00:01 2026-02-24T18:16:46.864 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:46.864 INFO:teuthology.orchestra.run.trial052.stdout:Total 26 MB/s | 95 MB 00:03 2026-02-24T18:16:46.873 INFO:teuthology.orchestra.run.trial080.stdout:(49/98): python3-pyasn1-modules-0.4.8-7.el9.noa 6.0 MB/s | 277 kB 00:00 2026-02-24T18:16:46.901 INFO:teuthology.orchestra.run.trial080.stdout:(50/98): python3-requests-oauthlib-1.3.0-12.el9 936 kB/s | 54 kB 00:00 2026-02-24T18:16:46.929 INFO:teuthology.orchestra.run.trial080.stdout:(51/98): python3-toml-0.10.2-6.el9.noarch.rpm 744 kB/s | 42 kB 00:00 2026-02-24T18:16:46.954 INFO:teuthology.orchestra.run.trial080.stdout:(52/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 3.5 MB/s | 189 kB 00:00 2026-02-24T18:16:46.966 INFO:teuthology.orchestra.run.trial080.stdout:(53/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 2.4 MB/s | 90 kB 00:00 2026-02-24T18:16:46.996 INFO:teuthology.orchestra.run.trial080.stdout:(54/98): lua-devel-5.4.4-4.el9.x86_64.rpm 527 kB/s | 22 kB 00:00 2026-02-24T18:16:47.068 INFO:teuthology.orchestra.run.trial080.stdout:(55/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 7.5 MB/s | 551 kB 00:00 2026-02-24T18:16:47.078 INFO:teuthology.orchestra.run.trial080.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 1.9 MB/s | 19 kB 00:00 2026-02-24T18:16:47.090 INFO:teuthology.orchestra.run.trial080.stdout:(57/98): luarocks-3.9.2-5.el9.noarch.rpm 13 MB/s | 151 kB 00:00 2026-02-24T18:16:47.092 INFO:teuthology.orchestra.run.trial080.stdout:(58/98): protobuf-compiler-3.14.0-17.el9.x86_64 6.7 MB/s | 862 kB 00:00 2026-02-24T18:16:47.108 INFO:teuthology.orchestra.run.trial080.stdout:(59/98): python3-asyncssh-2.13.2-5.el9.noarch.r 31 MB/s | 548 kB 00:00 2026-02-24T18:16:47.119 INFO:teuthology.orchestra.run.trial080.stdout:(60/98): python3-backports-tarfile-1.2.0-1.el9. 5.2 MB/s | 60 kB 00:00 2026-02-24T18:16:47.121 INFO:teuthology.orchestra.run.trial080.stdout:(61/98): python3-autocommand-2.2.2-8.el9.noarch 1.0 MB/s | 29 kB 00:00 2026-02-24T18:16:47.130 INFO:teuthology.orchestra.run.trial080.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 3.9 MB/s | 43 kB 00:00 2026-02-24T18:16:47.136 INFO:teuthology.orchestra.run.trial080.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 2.2 MB/s | 32 kB 00:00 2026-02-24T18:16:47.140 INFO:teuthology.orchestra.run.trial080.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 1.3 MB/s | 14 kB 00:00 2026-02-24T18:16:47.158 INFO:teuthology.orchestra.run.trial080.stdout:(65/98): python3-cherrypy-18.6.1-2.el9.noarch.r 20 MB/s | 358 kB 00:00 2026-02-24T18:16:47.164 INFO:teuthology.orchestra.run.trial080.stdout:(66/98): python3-cheroot-10.0.1-4.el9.noarch.rp 6.2 MB/s | 173 kB 00:00 2026-02-24T18:16:47.171 INFO:teuthology.orchestra.run.trial080.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 19 MB/s | 254 kB 00:00 2026-02-24T18:16:47.184 INFO:teuthology.orchestra.run.trial080.stdout:(68/98): python3-grpcio-tools-1.46.7-10.el9.x86 11 MB/s | 144 kB 00:00 2026-02-24T18:16:47.197 INFO:teuthology.orchestra.run.trial080.stdout:(69/98): python3-influxdb-5.3.1-1.el9.noarch.rp 11 MB/s | 139 kB 00:00 2026-02-24T18:16:47.209 INFO:teuthology.orchestra.run.trial080.stdout:(70/98): python3-isodate-0.6.1-3.el9.noarch.rpm 4.7 MB/s | 56 kB 00:00 2026-02-24T18:16:47.221 INFO:teuthology.orchestra.run.trial080.stdout:(71/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 36 MB/s | 2.0 MB 00:00 2026-02-24T18:16:47.221 INFO:teuthology.orchestra.run.trial080.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 885 kB/s | 11 kB 00:00 2026-02-24T18:16:47.231 INFO:teuthology.orchestra.run.trial080.stdout:(73/98): python3-jaraco-classes-3.2.1-5.el9.noa 1.7 MB/s | 18 kB 00:00 2026-02-24T18:16:47.232 INFO:teuthology.orchestra.run.trial080.stdout:(74/98): python3-jaraco-collections-3.0.0-8.el9 2.1 MB/s | 23 kB 00:00 2026-02-24T18:16:47.259 INFO:teuthology.orchestra.run.trial080.stdout:(75/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 46 MB/s | 19 MB 00:00 2026-02-24T18:16:47.260 INFO:teuthology.orchestra.run.trial080.stdout:(76/98): python3-jaraco-context-6.0.1-3.el9.noa 675 kB/s | 20 kB 00:00 2026-02-24T18:16:47.261 INFO:teuthology.orchestra.run.trial080.stdout:(77/98): python3-jaraco-functools-3.5.0-2.el9.n 689 kB/s | 19 kB 00:00 2026-02-24T18:16:47.271 INFO:teuthology.orchestra.run.trial080.stdout:(78/98): python3-logutils-0.3.5-21.el9.noarch.r 4.4 MB/s | 46 kB 00:00 2026-02-24T18:16:47.282 INFO:teuthology.orchestra.run.trial080.stdout:(79/98): python3-kubernetes-26.1.0-3.el9.noarch 49 MB/s | 1.0 MB 00:00 2026-02-24T18:16:47.282 INFO:teuthology.orchestra.run.trial080.stdout:(80/98): python3-more-itertools-8.12.0-2.el9.no 7.0 MB/s | 79 kB 00:00 2026-02-24T18:16:47.288 INFO:teuthology.orchestra.run.trial080.stdout:(81/98): python3-jaraco-text-4.0.0-2.el9.noarch 933 kB/s | 26 kB 00:00 2026-02-24T18:16:47.292 INFO:teuthology.orchestra.run.trial080.stdout:(82/98): python3-natsort-7.1.1-5.el9.noarch.rpm 5.5 MB/s | 58 kB 00:00 2026-02-24T18:16:47.293 INFO:teuthology.orchestra.run.trial080.stdout:(83/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 7.0 MB/s | 86 kB 00:00 2026-02-24T18:16:47.302 INFO:teuthology.orchestra.run.trial080.stdout:(84/98): python3-portend-3.1.0-2.el9.noarch.rpm 1.6 MB/s | 16 kB 00:00 2026-02-24T18:16:47.305 INFO:teuthology.orchestra.run.trial080.stdout:(85/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 7.9 MB/s | 90 kB 00:00 2026-02-24T18:16:47.306 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:16:47.312 INFO:teuthology.orchestra.run.trial080.stdout:(86/98): python3-repoze-lru-0.7-16.el9.noarch.r 3.0 MB/s | 31 kB 00:00 2026-02-24T18:16:47.317 INFO:teuthology.orchestra.run.trial080.stdout:(87/98): python3-routes-2.5.1-5.el9.noarch.rpm 15 MB/s | 188 kB 00:00 2026-02-24T18:16:47.322 INFO:teuthology.orchestra.run.trial080.stdout:(88/98): python3-rsa-4.9-2.el9.noarch.rpm 5.6 MB/s | 59 kB 00:00 2026-02-24T18:16:47.325 INFO:teuthology.orchestra.run.trial080.stdout:(89/98): python3-pecan-1.4.2-3.el9.noarch.rpm 7.0 MB/s | 272 kB 00:00 2026-02-24T18:16:47.329 INFO:teuthology.orchestra.run.trial080.stdout:(90/98): python3-saml-1.16.0-1.el9.noarch.rpm 10 MB/s | 125 kB 00:00 2026-02-24T18:16:47.332 INFO:teuthology.orchestra.run.trial080.stdout:(91/98): python3-tempora-5.0.0-2.el9.noarch.rpm 3.5 MB/s | 36 kB 00:00 2026-02-24T18:16:47.336 INFO:teuthology.orchestra.run.trial080.stdout:(92/98): python3-typing-extensions-4.15.0-1.el9 7.8 MB/s | 86 kB 00:00 2026-02-24T18:16:47.341 INFO:teuthology.orchestra.run.trial080.stdout:(93/98): python3-webob-1.8.8-2.el9.noarch.rpm 20 MB/s | 230 kB 00:00 2026-02-24T18:16:47.343 INFO:teuthology.orchestra.run.trial080.stdout:(94/98): python3-websocket-client-1.2.3-2.el9.n 8.1 MB/s | 90 kB 00:00 2026-02-24T18:16:47.344 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:16:47.344 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:16:47.353 INFO:teuthology.orchestra.run.trial080.stdout:(95/98): python3-xmltodict-0.12.0-15.el9.noarch 2.2 MB/s | 22 kB 00:00 2026-02-24T18:16:47.354 INFO:teuthology.orchestra.run.trial080.stdout:(96/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 3.7 MB/s | 48 kB 00:00 2026-02-24T18:16:47.356 INFO:teuthology.orchestra.run.trial080.stdout:(97/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 21 MB/s | 427 kB 00:00 2026-02-24T18:16:47.363 INFO:teuthology.orchestra.run.trial080.stdout:(98/98): python3-zc-lockfile-2.0-10.el9.noarch. 1.9 MB/s | 20 kB 00:00 2026-02-24T18:16:47.366 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:47.367 INFO:teuthology.orchestra.run.trial080.stdout:Total 17 MB/s | 95 MB 00:05 2026-02-24T18:16:47.761 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:16:47.762 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:16:47.799 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:16:47.838 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:16:47.838 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:16:48.211 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:16:48.213 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-24T18:16:48.244 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-24T18:16:48.249 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-24T18:16:48.255 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:16:48.256 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:16:48.271 INFO:teuthology.orchestra.run.trial052.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-24T18:16:48.281 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 5/98 2026-02-24T18:16:48.287 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-24T18:16:48.320 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-24T18:16:48.329 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-24T18:16:48.335 INFO:teuthology.orchestra.run.trial052.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-24T18:16:48.337 INFO:teuthology.orchestra.run.trial052.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-24T18:16:48.341 INFO:teuthology.orchestra.run.trial052.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-24T18:16:48.365 INFO:teuthology.orchestra.run.trial052.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-24T18:16:48.377 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-24T18:16:48.381 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-24T18:16:48.387 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-24T18:16:48.388 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-24T18:16:48.400 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-24T18:16:48.407 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-24T18:16:48.431 INFO:teuthology.orchestra.run.trial052.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-24T18:16:48.434 INFO:teuthology.orchestra.run.trial052.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-24T18:16:48.441 INFO:teuthology.orchestra.run.trial052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-24T18:16:48.466 INFO:teuthology.orchestra.run.trial052.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-24T18:16:48.518 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-24T18:16:48.531 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 24/98 2026-02-24T18:16:48.534 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-24T18:16:48.538 INFO:teuthology.orchestra.run.trial052.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-24T18:16:48.544 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-24T18:16:48.548 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-24T18:16:48.552 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-24T18:16:48.566 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-24T18:16:48.587 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-24T18:16:48.592 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-24T18:16:48.597 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-24T18:16:48.608 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-24T18:16:48.617 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-24T18:16:48.624 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-24T18:16:48.643 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-24T18:16:48.652 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-24T18:16:48.707 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-24T18:16:48.708 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:16:48.710 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-24T18:16:48.720 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-24T18:16:48.735 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-24T18:16:48.740 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-24T18:16:48.741 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-24T18:16:48.747 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-24T18:16:48.748 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-24T18:16:48.769 INFO:teuthology.orchestra.run.trial080.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-24T18:16:48.779 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 5/98 2026-02-24T18:16:48.785 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-24T18:16:48.788 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-24T18:16:48.819 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-24T18:16:48.828 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-24T18:16:48.833 INFO:teuthology.orchestra.run.trial080.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-24T18:16:48.836 INFO:teuthology.orchestra.run.trial080.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-24T18:16:48.841 INFO:teuthology.orchestra.run.trial080.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-24T18:16:48.864 INFO:teuthology.orchestra.run.trial080.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-24T18:16:48.877 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-24T18:16:48.880 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-24T18:16:48.886 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-24T18:16:48.888 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-24T18:16:48.899 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-24T18:16:48.905 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-24T18:16:48.930 INFO:teuthology.orchestra.run.trial080.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-24T18:16:48.933 INFO:teuthology.orchestra.run.trial080.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-24T18:16:48.940 INFO:teuthology.orchestra.run.trial080.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-24T18:16:48.965 INFO:teuthology.orchestra.run.trial080.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-24T18:16:49.016 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-24T18:16:49.028 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 24/98 2026-02-24T18:16:49.031 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-24T18:16:49.035 INFO:teuthology.orchestra.run.trial080.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-24T18:16:49.041 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-24T18:16:49.045 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-24T18:16:49.049 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-24T18:16:49.063 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-24T18:16:49.085 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-24T18:16:49.090 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-24T18:16:49.095 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-24T18:16:49.107 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-24T18:16:49.116 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-24T18:16:49.116 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-24T18:16:49.123 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-24T18:16:49.127 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-24T18:16:49.131 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-24T18:16:49.137 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-24T18:16:49.139 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-24T18:16:49.142 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-24T18:16:49.151 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-24T18:16:49.166 INFO:teuthology.orchestra.run.trial052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-24T18:16:49.206 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-24T18:16:49.212 INFO:teuthology.orchestra.run.trial052.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-24T18:16:49.218 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-24T18:16:49.219 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-24T18:16:49.222 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-24T18:16:49.228 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-24T18:16:49.232 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-24T18:16:49.233 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-24T18:16:49.238 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-24T18:16:49.239 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-24T18:16:49.242 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-24T18:16:49.246 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-24T18:16:49.271 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-24T18:16:49.281 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-24T18:16:49.286 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-24T18:16:49.316 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-24T18:16:49.544 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 61/98 2026-02-24T18:16:49.568 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-24T18:16:49.572 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-24T18:16:49.614 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-24T18:16:49.624 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-24T18:16:49.628 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-24T18:16:49.630 INFO:teuthology.orchestra.run.trial052.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-24T18:16:49.633 INFO:teuthology.orchestra.run.trial052.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-24T18:16:49.634 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-24T18:16:49.636 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-24T18:16:49.653 INFO:teuthology.orchestra.run.trial052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-24T18:16:49.664 INFO:teuthology.orchestra.run.trial080.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-24T18:16:49.707 INFO:teuthology.orchestra.run.trial080.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-24T18:16:49.714 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-24T18:16:49.717 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-24T18:16:49.723 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-24T18:16:49.727 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-24T18:16:49.734 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-24T18:16:49.737 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-24T18:16:49.765 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-24T18:16:49.775 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-24T18:16:49.810 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-24T18:16:49.984 INFO:teuthology.orchestra.run.trial052.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-24T18:16:50.036 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 61/98 2026-02-24T18:16:50.058 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-24T18:16:50.060 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-24T18:16:50.064 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-24T18:16:50.123 INFO:teuthology.orchestra.run.trial080.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-24T18:16:50.125 INFO:teuthology.orchestra.run.trial080.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-24T18:16:50.146 INFO:teuthology.orchestra.run.trial080.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-24T18:16:50.474 INFO:teuthology.orchestra.run.trial080.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-24T18:16:50.548 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-24T18:16:50.738 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-24T18:16:50.757 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-24T18:16:50.770 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-24T18:16:50.786 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-24T18:16:50.863 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-24T18:16:50.871 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-24T18:16:50.895 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-24T18:16:50.925 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-24T18:16:50.976 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-24T18:16:50.982 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-24T18:16:50.986 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-24T18:16:50.987 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-24T18:16:51.006 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-24T18:16:51.006 INFO:teuthology.orchestra.run.trial052.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:16:51.006 INFO:teuthology.orchestra.run.trial052.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:16:51.006 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:51.014 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-24T18:16:51.039 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-24T18:16:51.040 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:16:51.040 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:51.074 INFO:teuthology.orchestra.run.trial052.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-24T18:16:51.139 INFO:teuthology.orchestra.run.trial052.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 83/98 2026-02-24T18:16:51.141 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 84/98 2026-02-24T18:16:51.155 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 84/98 2026-02-24T18:16:51.155 INFO:teuthology.orchestra.run.trial052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:51.155 INFO:teuthology.orchestra.run.trial052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:16:51.155 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:51.227 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-24T18:16:51.245 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-24T18:16:51.259 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-24T18:16:51.275 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-24T18:16:51.351 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-24T18:16:51.360 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-24T18:16:51.383 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-24T18:16:51.413 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-24T18:16:51.464 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-24T18:16:51.470 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-24T18:16:51.475 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-24T18:16:51.476 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-24T18:16:51.496 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-24T18:16:51.496 INFO:teuthology.orchestra.run.trial080.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:16:51.496 INFO:teuthology.orchestra.run.trial080.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:16:51.497 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:51.505 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-24T18:16:51.532 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-24T18:16:51.532 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:16:51.532 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:51.566 INFO:teuthology.orchestra.run.trial080.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-24T18:16:51.630 INFO:teuthology.orchestra.run.trial080.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 83/98 2026-02-24T18:16:51.632 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 84/98 2026-02-24T18:16:51.646 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 84/98 2026-02-24T18:16:51.647 INFO:teuthology.orchestra.run.trial080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:51.647 INFO:teuthology.orchestra.run.trial080.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:16:51.647 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:51.849 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 85/98 2026-02-24T18:16:51.875 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 85/98 2026-02-24T18:16:51.875 INFO:teuthology.orchestra.run.trial052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:51.875 INFO:teuthology.orchestra.run.trial052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:16:51.876 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:16:51.876 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:16:51.876 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:51.934 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 86/98 2026-02-24T18:16:51.937 INFO:teuthology.orchestra.run.trial052.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 86/98 2026-02-24T18:16:51.941 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 87/98 2026-02-24T18:16:51.962 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 88/98 2026-02-24T18:16:51.963 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 89/98 2026-02-24T18:16:52.357 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 85/98 2026-02-24T18:16:52.382 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 85/98 2026-02-24T18:16:52.382 INFO:teuthology.orchestra.run.trial080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:52.382 INFO:teuthology.orchestra.run.trial080.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:16:52.383 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:16:52.383 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:16:52.383 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:52.442 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 86/98 2026-02-24T18:16:52.443 INFO:teuthology.orchestra.run.trial080.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 86/98 2026-02-24T18:16:52.448 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 87/98 2026-02-24T18:16:52.455 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 89/98 2026-02-24T18:16:52.458 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 90/98 2026-02-24T18:16:52.468 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 88/98 2026-02-24T18:16:52.469 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 89/98 2026-02-24T18:16:52.913 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 90/98 2026-02-24T18:16:52.913 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 91/98 2026-02-24T18:16:52.926 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 91/98 2026-02-24T18:16:52.926 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 92/98 2026-02-24T18:16:52.965 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 89/98 2026-02-24T18:16:52.968 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 90/98 2026-02-24T18:16:52.983 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 92/98 2026-02-24T18:16:53.032 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 93/98 2026-02-24T18:16:53.033 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 94/98 2026-02-24T18:16:53.055 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 94/98 2026-02-24T18:16:53.056 INFO:teuthology.orchestra.run.trial052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:53.056 INFO:teuthology.orchestra.run.trial052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:16:53.056 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:16:53.056 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:16:53.056 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:53.067 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 95/98 2026-02-24T18:16:53.282 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 95/98 2026-02-24T18:16:53.283 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 96/98 2026-02-24T18:16:53.304 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 96/98 2026-02-24T18:16:53.304 INFO:teuthology.orchestra.run.trial052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:53.305 INFO:teuthology.orchestra.run.trial052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:16:53.305 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:16:53.305 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:16:53.305 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:53.406 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 97/98 2026-02-24T18:16:53.426 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 97/98 2026-02-24T18:16:53.426 INFO:teuthology.orchestra.run.trial052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:53.426 INFO:teuthology.orchestra.run.trial052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:16:53.426 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:16:53.426 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:16:53.426 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:53.431 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 90/98 2026-02-24T18:16:53.432 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 91/98 2026-02-24T18:16:53.446 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 98/98 2026-02-24T18:16:53.446 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 91/98 2026-02-24T18:16:53.447 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 92/98 2026-02-24T18:16:53.503 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 92/98 2026-02-24T18:16:53.553 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 93/98 2026-02-24T18:16:53.554 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 94/98 2026-02-24T18:16:53.577 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 94/98 2026-02-24T18:16:53.578 INFO:teuthology.orchestra.run.trial080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:53.578 INFO:teuthology.orchestra.run.trial080.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:16:53.578 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:16:53.578 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:16:53.578 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:53.589 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 95/98 2026-02-24T18:16:53.810 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 95/98 2026-02-24T18:16:53.812 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 96/98 2026-02-24T18:16:53.833 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 96/98 2026-02-24T18:16:53.833 INFO:teuthology.orchestra.run.trial080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:53.834 INFO:teuthology.orchestra.run.trial080.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:16:53.834 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:16:53.834 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:16:53.834 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:53.936 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 97/98 2026-02-24T18:16:53.956 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 97/98 2026-02-24T18:16:53.957 INFO:teuthology.orchestra.run.trial080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:53.957 INFO:teuthology.orchestra.run.trial080.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:16:53.957 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:16:53.957 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:16:53.957 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:53.976 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 98/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 98/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 3/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 4/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 5/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 6/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 7/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 8/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 9/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 10/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 11/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 12/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 13/98 2026-02-24T18:16:54.108 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 14/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 15/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 38/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-24T18:16:54.109 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 48/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 49/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-24T18:16:54.110 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-24T18:16:54.111 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:16:54.181 INFO:teuthology.orchestra.run.trial052.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:16:54.182 INFO:teuthology.orchestra.run.trial052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:54.183 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:54.236 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-base 2026-02-24T18:16:54.556 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:33 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 98/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 3/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 4/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 5/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 6/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 7/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 8/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 9/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 10/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 11/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 12/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 13/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 14/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 15/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-24T18:16:54.610 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 38/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 48/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 49/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-24T18:16:54.611 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-24T18:16:54.612 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-24T18:16:54.623 INFO:teuthology.orchestra.run.trial052.stdout:Package ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:16:54.642 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:54.643 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:16:54.643 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:54.665 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install cephadm 2026-02-24T18:16:54.683 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-24T18:16:54.683 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:54.683 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:16:54.683 INFO:teuthology.orchestra.run.trial080.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:16:54.683 INFO:teuthology.orchestra.run.trial080.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:54.683 INFO:teuthology.orchestra.run.trial080.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.683 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:54.683 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:16:54.684 INFO:teuthology.orchestra.run.trial080.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T18:16:54.685 INFO:teuthology.orchestra.run.trial080.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:16:54.686 INFO:teuthology.orchestra.run.trial080.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:16:54.686 INFO:teuthology.orchestra.run.trial080.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:16:54.686 INFO:teuthology.orchestra.run.trial080.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T18:16:54.686 INFO:teuthology.orchestra.run.trial080.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T18:16:54.686 INFO:teuthology.orchestra.run.trial080.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:16:54.686 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:54.686 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:54.739 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-base 2026-02-24T18:16:54.976 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:33 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:55.044 INFO:teuthology.orchestra.run.trial052.stdout:Package cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:55.061 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:33 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:55.062 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:55.062 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:16:55.062 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:55.084 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:16:55.127 INFO:teuthology.orchestra.run.trial080.stdout:Package ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:16:55.146 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:55.147 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:16:55.147 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:55.169 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install cephadm 2026-02-24T18:16:55.400 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:34 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:55.481 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:33 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:55.485 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:55.486 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:55.486 INFO:teuthology.orchestra.run.trial052.stdout: Package Arch Version Repo Size 2026-02-24T18:16:55.486 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:55.486 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:16:55.486 INFO:teuthology.orchestra.run.trial052.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-24T18:16:55.486 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:55.487 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:16:55.487 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:55.487 INFO:teuthology.orchestra.run.trial052.stdout:Install 1 Package 2026-02-24T18:16:55.487 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:55.487 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 145 k 2026-02-24T18:16:55.487 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 431 k 2026-02-24T18:16:55.487 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:16:55.546 INFO:teuthology.orchestra.run.trial080.stdout:Package cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:55.564 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:55.565 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:16:55.565 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:55.574 INFO:teuthology.orchestra.run.trial052.stdout:ceph-immutable-object-cache-19.2.3-689.gf90f4ea 1.6 MB/s | 145 kB 00:00 2026-02-24T18:16:55.574 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:55.574 INFO:teuthology.orchestra.run.trial052.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-24T18:16:55.574 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:16:55.578 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:16:55.578 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:16:55.585 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:16:55.610 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:16:55.610 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:16:55.668 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:16:55.669 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-24T18:16:55.690 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-24T18:16:55.691 INFO:teuthology.orchestra.run.trial052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:55.691 INFO:teuthology.orchestra.run.trial052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:16:55.691 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:55.907 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:33 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout: Package Arch Version Repo Size 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout:Install 1 Package 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:55.993 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 145 k 2026-02-24T18:16:55.994 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 431 k 2026-02-24T18:16:55.994 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:16:56.013 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-24T18:16:56.013 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:56.013 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:16:56.013 INFO:teuthology.orchestra.run.trial052.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:56.014 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:56.014 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:56.041 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-mgr 2026-02-24T18:16:56.079 INFO:teuthology.orchestra.run.trial080.stdout:ceph-immutable-object-cache-19.2.3-689.gf90f4ea 1.7 MB/s | 145 kB 00:00 2026-02-24T18:16:56.079 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:56.079 INFO:teuthology.orchestra.run.trial080.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-24T18:16:56.080 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:16:56.084 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:16:56.084 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:16:56.115 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:16:56.115 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:16:56.171 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:16:56.172 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-24T18:16:56.196 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-24T18:16:56.197 INFO:teuthology.orchestra.run.trial080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:16:56.197 INFO:teuthology.orchestra.run.trial080.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:16:56.197 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:56.362 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:35 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:56.429 INFO:teuthology.orchestra.run.trial052.stdout:Package ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:16:56.448 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:56.448 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:16:56.449 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:56.469 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:16:56.508 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-24T18:16:56.508 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:56.509 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:16:56.509 INFO:teuthology.orchestra.run.trial080.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:56.509 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:56.509 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:56.536 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-mgr 2026-02-24T18:16:56.786 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:35 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:56.850 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:34 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:56.852 INFO:teuthology.orchestra.run.trial052.stdout:Package ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:56.871 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:56.872 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:16:56.872 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:56.894 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:16:56.916 INFO:teuthology.orchestra.run.trial080.stdout:Package ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:16:56.935 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:56.935 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:16:56.936 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:56.956 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:16:57.210 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:36 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:57.275 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:35 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:57.276 INFO:teuthology.orchestra.run.trial052.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:57.294 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:57.295 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:16:57.295 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:57.317 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:16:57.340 INFO:teuthology.orchestra.run.trial080.stdout:Package ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:57.359 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:57.359 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:16:57.359 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:57.381 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:16:57.630 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:36 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:57.693 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:35 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:57.697 INFO:teuthology.orchestra.run.trial052.stdout:Package ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:57.716 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:57.717 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:16:57.717 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:57.738 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:16:57.759 INFO:teuthology.orchestra.run.trial080.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:57.777 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:57.778 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:16:57.778 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:57.799 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:16:58.054 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:37 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:58.118 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:36 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:58.120 INFO:teuthology.orchestra.run.trial052.stdout:Package ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:58.139 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:58.140 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:16:58.140 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:58.161 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-fuse 2026-02-24T18:16:58.184 INFO:teuthology.orchestra.run.trial080.stdout:Package ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:58.202 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:58.203 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:16:58.203 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:58.224 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:16:58.479 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:37 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:58.543 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:36 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:58.564 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:58.564 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:58.564 INFO:teuthology.orchestra.run.trial052.stdout: Package Architecture Version Repository Size 2026-02-24T18:16:58.564 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:58.564 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:16:58.564 INFO:teuthology.orchestra.run.trial052.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-24T18:16:58.564 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:58.565 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:16:58.565 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:58.565 INFO:teuthology.orchestra.run.trial052.stdout:Install 1 Package 2026-02-24T18:16:58.565 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:58.565 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 1.2 M 2026-02-24T18:16:58.565 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 3.6 M 2026-02-24T18:16:58.565 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:16:58.608 INFO:teuthology.orchestra.run.trial080.stdout:Package ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:58.628 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:58.629 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:16:58.629 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:58.650 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-fuse 2026-02-24T18:16:58.686 INFO:teuthology.orchestra.run.trial052.stdout:ceph-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 9.5 MB/s | 1.2 MB 00:00 2026-02-24T18:16:58.687 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:58.687 INFO:teuthology.orchestra.run.trial052.stdout:Total 9.4 MB/s | 1.2 MB 00:00 2026-02-24T18:16:58.687 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:16:58.691 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:16:58.691 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:16:58.730 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:16:58.730 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:16:58.834 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:16:58.852 INFO:teuthology.orchestra.run.trial052.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:16:58.972 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:36 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:16:59.058 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:16:59.058 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:59.058 INFO:teuthology.orchestra.run.trial080.stdout: Package Architecture Version Repository Size 2026-02-24T18:16:59.058 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:59.058 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:16:59.058 INFO:teuthology.orchestra.run.trial080.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-24T18:16:59.058 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:59.059 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:16:59.059 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:16:59.059 INFO:teuthology.orchestra.run.trial080.stdout:Install 1 Package 2026-02-24T18:16:59.059 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:59.059 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 1.2 M 2026-02-24T18:16:59.059 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 3.6 M 2026-02-24T18:16:59.059 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:16:59.072 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:16:59.134 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:16:59.134 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:59.134 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:16:59.134 INFO:teuthology.orchestra.run.trial052.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:59.134 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:59.134 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:59.165 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install ceph-volume 2026-02-24T18:16:59.180 INFO:teuthology.orchestra.run.trial080.stdout:ceph-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 9.5 MB/s | 1.2 MB 00:00 2026-02-24T18:16:59.180 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:16:59.181 INFO:teuthology.orchestra.run.trial080.stdout:Total 9.4 MB/s | 1.2 MB 00:00 2026-02-24T18:16:59.181 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:16:59.184 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:16:59.185 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:16:59.222 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:16:59.222 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:16:59.326 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:16:59.344 INFO:teuthology.orchestra.run.trial080.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:16:59.488 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:38 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:59.553 INFO:teuthology.orchestra.run.trial052.stdout:Package ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:16:59.572 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:59.573 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:16:59.573 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:16:59.591 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:16:59.594 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install librados-devel 2026-02-24T18:16:59.653 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:16:59.653 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:59.654 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:16:59.654 INFO:teuthology.orchestra.run.trial080.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:16:59.654 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:16:59.654 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:16:59.680 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install ceph-volume 2026-02-24T18:16:59.914 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:38 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:16:59.998 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout: Package Arch Version Repo Size 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout:Install 1 Package 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 126 k 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 456 k 2026-02-24T18:16:59.999 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:17:00.005 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:38 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:00.071 INFO:teuthology.orchestra.run.trial080.stdout:Package ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-24T18:17:00.086 INFO:teuthology.orchestra.run.trial052.stdout:librados-devel-19.2.3-689.gf90f4eae.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-24T18:17:00.086 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:00.086 INFO:teuthology.orchestra.run.trial052.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-24T18:17:00.086 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:17:00.089 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:17:00.089 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:17:00.090 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:00.090 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:17:00.091 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:00.112 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install librados-devel 2026-02-24T18:17:00.120 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:17:00.120 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:17:00.176 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:17:00.193 INFO:teuthology.orchestra.run.trial052.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:00.277 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:00.341 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:00.341 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:00.341 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:17:00.341 INFO:teuthology.orchestra.run.trial052.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:17:00.341 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:00.341 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:00.370 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install libcephfs2 2026-02-24T18:17:00.427 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:38 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:00.511 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:00.511 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout: Package Arch Version Repo Size 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout:Install 1 Package 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 126 k 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 456 k 2026-02-24T18:17:00.512 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:17:00.598 INFO:teuthology.orchestra.run.trial080.stdout:librados-devel-19.2.3-689.gf90f4eae.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-24T18:17:00.599 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:00.599 INFO:teuthology.orchestra.run.trial080.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-24T18:17:00.599 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:17:00.602 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:17:00.602 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:17:00.633 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:17:00.633 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:17:00.686 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:39 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:00.688 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:17:00.706 INFO:teuthology.orchestra.run.trial080.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:00.752 INFO:teuthology.orchestra.run.trial052.stdout:Package libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:00.770 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:00.771 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:17:00.771 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:00.792 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install libcephfs-devel 2026-02-24T18:17:00.794 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:00.854 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:00.855 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:00.855 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:17:00.855 INFO:teuthology.orchestra.run.trial080.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:17:00.855 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:00.855 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:00.882 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install libcephfs2 2026-02-24T18:17:01.114 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:40 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:01.199 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:01.199 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:01.200 INFO:teuthology.orchestra.run.trial052.stdout: Package Arch Version Repo Size 2026-02-24T18:17:01.200 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:01.200 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:17:01.200 INFO:teuthology.orchestra.run.trial052.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-24T18:17:01.200 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:01.200 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:17:01.200 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:01.200 INFO:teuthology.orchestra.run.trial052.stdout:Install 1 Package 2026-02-24T18:17:01.200 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:01.200 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 34 k 2026-02-24T18:17:01.201 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 153 k 2026-02-24T18:17:01.201 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:17:01.203 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:39 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:01.263 INFO:teuthology.orchestra.run.trial052.stdout:libcephfs-devel-19.2.3-689.gf90f4eae.el9.x86_64 532 kB/s | 34 kB 00:00 2026-02-24T18:17:01.263 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:01.263 INFO:teuthology.orchestra.run.trial052.stdout:Total 526 kB/s | 34 kB 00:00 2026-02-24T18:17:01.263 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:17:01.265 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:17:01.265 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:17:01.267 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:17:01.267 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:17:01.268 INFO:teuthology.orchestra.run.trial080.stdout:Package libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:01.287 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:01.287 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:17:01.287 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:01.288 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:17:01.305 INFO:teuthology.orchestra.run.trial052.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:01.308 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install libcephfs-devel 2026-02-24T18:17:01.365 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:01.428 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:01.428 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:01.428 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:17:01.428 INFO:teuthology.orchestra.run.trial052.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:17:01.428 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:01.428 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:01.454 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install librados2 2026-02-24T18:17:01.624 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:39 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout: Package Arch Version Repo Size 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout:Install 1 Package 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 34 k 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 153 k 2026-02-24T18:17:01.709 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:17:01.770 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:40 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:01.836 INFO:teuthology.orchestra.run.trial052.stdout:Package librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:01.854 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:01.855 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:17:01.855 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:01.876 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install librbd1 2026-02-24T18:17:01.999 INFO:teuthology.orchestra.run.trial080.stdout:libcephfs-devel-19.2.3-689.gf90f4eae.el9.x86_64 116 kB/s | 34 kB 00:00 2026-02-24T18:17:01.999 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:01.999 INFO:teuthology.orchestra.run.trial080.stdout:Total 116 kB/s | 34 kB 00:00 2026-02-24T18:17:01.999 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:17:02.001 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:17:02.001 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:17:02.003 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:17:02.004 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:17:02.026 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:17:02.044 INFO:teuthology.orchestra.run.trial080.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:02.104 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:02.166 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:02.166 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:02.166 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:17:02.166 INFO:teuthology.orchestra.run.trial080.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:17:02.166 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:02.166 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:02.192 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:41 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:02.194 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install librados2 2026-02-24T18:17:02.258 INFO:teuthology.orchestra.run.trial052.stdout:Package librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:02.276 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:02.277 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:17:02.277 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:02.298 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install python3-rados 2026-02-24T18:17:02.516 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:40 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:02.581 INFO:teuthology.orchestra.run.trial080.stdout:Package librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:02.600 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:02.601 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:17:02.601 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:02.615 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:41 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:02.622 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install librbd1 2026-02-24T18:17:02.683 INFO:teuthology.orchestra.run.trial052.stdout:Package python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:02.702 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:02.702 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:17:02.702 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:02.724 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install python3-rgw 2026-02-24T18:17:02.937 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:40 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:03.002 INFO:teuthology.orchestra.run.trial080.stdout:Package librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:03.021 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:03.021 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:17:03.021 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:03.039 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:42 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:03.043 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install python3-rados 2026-02-24T18:17:03.104 INFO:teuthology.orchestra.run.trial052.stdout:Package python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:03.123 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:03.124 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:17:03.124 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:03.144 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install python3-cephfs 2026-02-24T18:17:03.363 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:41 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:03.430 INFO:teuthology.orchestra.run.trial080.stdout:Package python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:03.448 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:03.449 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:17:03.449 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:03.457 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:42 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:03.470 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install python3-rgw 2026-02-24T18:17:03.523 INFO:teuthology.orchestra.run.trial052.stdout:Package python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:03.541 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:03.542 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:17:03.542 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:03.563 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install python3-rbd 2026-02-24T18:17:03.786 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:41 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:03.852 INFO:teuthology.orchestra.run.trial080.stdout:Package python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:03.871 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:03.871 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:17:03.872 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:03.872 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:42 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:03.893 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install python3-cephfs 2026-02-24T18:17:03.938 INFO:teuthology.orchestra.run.trial052.stdout:Package python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:03.957 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:03.957 INFO:teuthology.orchestra.run.trial052.stdout:Nothing to do. 2026-02-24T18:17:03.957 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:03.979 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install rbd-fuse 2026-02-24T18:17:04.206 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:42 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:04.273 INFO:teuthology.orchestra.run.trial080.stdout:Package python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:04.292 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:04.293 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:17:04.293 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:04.294 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:43 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:04.315 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install python3-rbd 2026-02-24T18:17:04.379 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:04.379 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout: Package Architecture Version Repository Size 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout:Install 1 Package 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 85 k 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 227 k 2026-02-24T18:17:04.380 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:17:04.634 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:42 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:04.660 INFO:teuthology.orchestra.run.trial052.stdout:rbd-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 304 kB/s | 85 kB 00:00 2026-02-24T18:17:04.661 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:04.661 INFO:teuthology.orchestra.run.trial052.stdout:Total 303 kB/s | 85 kB 00:00 2026-02-24T18:17:04.661 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:17:04.665 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:17:04.665 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:17:04.697 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:17:04.697 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:17:04.700 INFO:teuthology.orchestra.run.trial080.stdout:Package python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-24T18:17:04.719 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:04.719 INFO:teuthology.orchestra.run.trial080.stdout:Nothing to do. 2026-02-24T18:17:04.719 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:04.741 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install rbd-fuse 2026-02-24T18:17:04.749 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:17:04.767 INFO:teuthology.orchestra.run.trial052.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:04.852 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:04.914 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:04.914 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:04.914 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:17:04.914 INFO:teuthology.orchestra.run.trial052.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:17:04.914 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:04.914 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:04.943 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install rbd-mirror 2026-02-24T18:17:05.056 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:43 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout: Package Architecture Version Repository Size 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout:Install 1 Package 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 85 k 2026-02-24T18:17:05.141 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 227 k 2026-02-24T18:17:05.142 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:17:05.260 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:44 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:05.347 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:05.347 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:05.347 INFO:teuthology.orchestra.run.trial052.stdout: Package Arch Version Repo Size 2026-02-24T18:17:05.347 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:05.348 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:17:05.348 INFO:teuthology.orchestra.run.trial052.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-24T18:17:05.348 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:05.348 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:17:05.348 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:05.348 INFO:teuthology.orchestra.run.trial052.stdout:Install 1 Package 2026-02-24T18:17:05.348 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:05.348 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 3.1 M 2026-02-24T18:17:05.348 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 13 M 2026-02-24T18:17:05.348 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:17:05.382 INFO:teuthology.orchestra.run.trial080.stdout:rbd-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 353 kB/s | 85 kB 00:00 2026-02-24T18:17:05.382 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:05.383 INFO:teuthology.orchestra.run.trial080.stdout:Total 351 kB/s | 85 kB 00:00 2026-02-24T18:17:05.383 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:17:05.387 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:17:05.387 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:17:05.419 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:17:05.419 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:17:05.472 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:17:05.489 INFO:teuthology.orchestra.run.trial080.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:05.578 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:05.640 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:05.640 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:05.640 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:17:05.641 INFO:teuthology.orchestra.run.trial080.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:17:05.641 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:05.641 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:05.668 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install rbd-mirror 2026-02-24T18:17:05.985 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:43 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:06.070 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:06.071 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:06.071 INFO:teuthology.orchestra.run.trial080.stdout: Package Arch Version Repo Size 2026-02-24T18:17:06.071 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:06.071 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:17:06.071 INFO:teuthology.orchestra.run.trial080.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-24T18:17:06.071 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:06.071 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:17:06.071 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:06.071 INFO:teuthology.orchestra.run.trial080.stdout:Install 1 Package 2026-02-24T18:17:06.072 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:06.072 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 3.1 M 2026-02-24T18:17:06.072 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 13 M 2026-02-24T18:17:06.072 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:17:06.738 INFO:teuthology.orchestra.run.trial052.stdout:rbd-mirror-19.2.3-689.gf90f4eae.el9.x86_64.rpm 2.2 MB/s | 3.1 MB 00:01 2026-02-24T18:17:06.738 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:06.738 INFO:teuthology.orchestra.run.trial052.stdout:Total 2.2 MB/s | 3.1 MB 00:01 2026-02-24T18:17:06.739 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:17:06.742 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:17:06.742 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:17:06.784 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:17:06.784 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:17:06.977 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:17:06.979 INFO:teuthology.orchestra.run.trial052.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:07.003 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:07.003 INFO:teuthology.orchestra.run.trial052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:17:07.003 INFO:teuthology.orchestra.run.trial052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:17:07.003 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:17:07.004 INFO:teuthology.orchestra.run.trial052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:17:07.004 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:07.227 INFO:teuthology.orchestra.run.trial080.stdout:rbd-mirror-19.2.3-689.gf90f4eae.el9.x86_64.rpm 2.7 MB/s | 3.1 MB 00:01 2026-02-24T18:17:07.228 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:07.228 INFO:teuthology.orchestra.run.trial080.stdout:Total 2.7 MB/s | 3.1 MB 00:01 2026-02-24T18:17:07.228 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:17:07.232 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:17:07.232 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:17:07.273 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:17:07.273 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:17:07.334 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:07.334 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:07.334 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:17:07.334 INFO:teuthology.orchestra.run.trial052.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:17:07.334 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:07.334 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:07.364 DEBUG:teuthology.orchestra.run.trial052:> sudo yum -y install rbd-nbd 2026-02-24T18:17:07.466 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:17:07.467 INFO:teuthology.orchestra.run.trial080.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:07.489 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:07.490 INFO:teuthology.orchestra.run.trial080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:17:07.490 INFO:teuthology.orchestra.run.trial080.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:17:07.490 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:17:07.490 INFO:teuthology.orchestra.run.trial080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:17:07.490 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:07.683 INFO:teuthology.orchestra.run.trial052.stdout:Last metadata expiration check: 0:00:46 ago on Tue 24 Feb 2026 06:16:21 PM UTC. 2026-02-24T18:17:07.766 INFO:teuthology.orchestra.run.trial052.stdout:Dependencies resolved. 2026-02-24T18:17:07.767 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:07.767 INFO:teuthology.orchestra.run.trial052.stdout: Package Architecture Version Repository Size 2026-02-24T18:17:07.767 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:07.767 INFO:teuthology.orchestra.run.trial052.stdout:Installing: 2026-02-24T18:17:07.767 INFO:teuthology.orchestra.run.trial052.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-24T18:17:07.767 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:07.768 INFO:teuthology.orchestra.run.trial052.stdout:Transaction Summary 2026-02-24T18:17:07.768 INFO:teuthology.orchestra.run.trial052.stdout:================================================================================ 2026-02-24T18:17:07.768 INFO:teuthology.orchestra.run.trial052.stdout:Install 1 Package 2026-02-24T18:17:07.768 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:07.768 INFO:teuthology.orchestra.run.trial052.stdout:Total download size: 170 k 2026-02-24T18:17:07.768 INFO:teuthology.orchestra.run.trial052.stdout:Installed size: 490 k 2026-02-24T18:17:07.768 INFO:teuthology.orchestra.run.trial052.stdout:Downloading Packages: 2026-02-24T18:17:07.824 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:07.824 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:07.824 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:17:07.825 INFO:teuthology.orchestra.run.trial080.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:17:07.825 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:07.825 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:07.853 DEBUG:teuthology.orchestra.run.trial080:> sudo yum -y install rbd-nbd 2026-02-24T18:17:08.169 INFO:teuthology.orchestra.run.trial080.stdout:Last metadata expiration check: 0:00:46 ago on Tue 24 Feb 2026 06:16:22 PM UTC. 2026-02-24T18:17:08.204 INFO:teuthology.orchestra.run.trial052.stdout:rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_64.rpm 390 kB/s | 170 kB 00:00 2026-02-24T18:17:08.205 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:08.205 INFO:teuthology.orchestra.run.trial052.stdout:Total 389 kB/s | 170 kB 00:00 2026-02-24T18:17:08.205 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction check 2026-02-24T18:17:08.209 INFO:teuthology.orchestra.run.trial052.stdout:Transaction check succeeded. 2026-02-24T18:17:08.209 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction test 2026-02-24T18:17:08.241 INFO:teuthology.orchestra.run.trial052.stdout:Transaction test succeeded. 2026-02-24T18:17:08.241 INFO:teuthology.orchestra.run.trial052.stdout:Running transaction 2026-02-24T18:17:08.253 INFO:teuthology.orchestra.run.trial080.stdout:Dependencies resolved. 2026-02-24T18:17:08.253 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:08.253 INFO:teuthology.orchestra.run.trial080.stdout: Package Architecture Version Repository Size 2026-02-24T18:17:08.253 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:08.253 INFO:teuthology.orchestra.run.trial080.stdout:Installing: 2026-02-24T18:17:08.253 INFO:teuthology.orchestra.run.trial080.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-24T18:17:08.253 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:08.254 INFO:teuthology.orchestra.run.trial080.stdout:Transaction Summary 2026-02-24T18:17:08.254 INFO:teuthology.orchestra.run.trial080.stdout:================================================================================ 2026-02-24T18:17:08.254 INFO:teuthology.orchestra.run.trial080.stdout:Install 1 Package 2026-02-24T18:17:08.254 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:08.254 INFO:teuthology.orchestra.run.trial080.stdout:Total download size: 170 k 2026-02-24T18:17:08.254 INFO:teuthology.orchestra.run.trial080.stdout:Installed size: 490 k 2026-02-24T18:17:08.254 INFO:teuthology.orchestra.run.trial080.stdout:Downloading Packages: 2026-02-24T18:17:08.298 INFO:teuthology.orchestra.run.trial052.stdout: Preparing : 1/1 2026-02-24T18:17:08.315 INFO:teuthology.orchestra.run.trial052.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:08.401 INFO:teuthology.orchestra.run.trial052.stdout: Running scriptlet: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:08.463 INFO:teuthology.orchestra.run.trial052.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:08.464 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:08.464 INFO:teuthology.orchestra.run.trial052.stdout:Installed: 2026-02-24T18:17:08.464 INFO:teuthology.orchestra.run.trial052.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:17:08.464 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:08.464 INFO:teuthology.orchestra.run.trial052.stdout:Complete! 2026-02-24T18:17:08.495 DEBUG:teuthology.parallel:result is None 2026-02-24T18:17:08.642 INFO:teuthology.orchestra.run.trial080.stdout:rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_64.rpm 440 kB/s | 170 kB 00:00 2026-02-24T18:17:08.642 INFO:teuthology.orchestra.run.trial080.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:08.642 INFO:teuthology.orchestra.run.trial080.stdout:Total 439 kB/s | 170 kB 00:00 2026-02-24T18:17:08.642 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction check 2026-02-24T18:17:08.646 INFO:teuthology.orchestra.run.trial080.stdout:Transaction check succeeded. 2026-02-24T18:17:08.647 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction test 2026-02-24T18:17:08.679 INFO:teuthology.orchestra.run.trial080.stdout:Transaction test succeeded. 2026-02-24T18:17:08.679 INFO:teuthology.orchestra.run.trial080.stdout:Running transaction 2026-02-24T18:17:08.736 INFO:teuthology.orchestra.run.trial080.stdout: Preparing : 1/1 2026-02-24T18:17:08.753 INFO:teuthology.orchestra.run.trial080.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:08.842 INFO:teuthology.orchestra.run.trial080.stdout: Running scriptlet: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:08.904 INFO:teuthology.orchestra.run.trial080.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-24T18:17:08.904 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:08.904 INFO:teuthology.orchestra.run.trial080.stdout:Installed: 2026-02-24T18:17:08.904 INFO:teuthology.orchestra.run.trial080.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-24T18:17:08.904 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:17:08.904 INFO:teuthology.orchestra.run.trial080.stdout:Complete! 2026-02-24T18:17:08.936 DEBUG:teuthology.parallel:result is None 2026-02-24T18:17:08.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-24T18:17:09.073 DEBUG:teuthology.orchestra.run.trial052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T18:17:09.094 INFO:teuthology.orchestra.run.trial052.stdout:19.2.3-689.gf90f4eae.el9 2026-02-24T18:17:09.094 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-24T18:17:09.095 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-24T18:17:09.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-24T18:17:09.233 DEBUG:teuthology.orchestra.run.trial080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T18:17:09.256 INFO:teuthology.orchestra.run.trial080.stdout:19.2.3-689.gf90f4eae.el9 2026-02-24T18:17:09.256 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-24T18:17:09.256 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-24T18:17:09.258 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T18:17:09.258 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:17:09.258 DEBUG:teuthology.orchestra.run.trial052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T18:17:09.284 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:17:09.284 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T18:17:09.321 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T18:17:09.321 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:17:09.321 DEBUG:teuthology.orchestra.run.trial052:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T18:17:09.349 DEBUG:teuthology.orchestra.run.trial052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T18:17:09.412 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:17:09.412 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T18:17:09.437 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T18:17:09.501 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T18:17:09.502 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:17:09.502 DEBUG:teuthology.orchestra.run.trial052:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T18:17:09.527 DEBUG:teuthology.orchestra.run.trial052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T18:17:09.590 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:17:09.591 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T18:17:09.617 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T18:17:09.681 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T18:17:09.682 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:17:09.682 DEBUG:teuthology.orchestra.run.trial052:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T18:17:09.708 DEBUG:teuthology.orchestra.run.trial052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T18:17:09.771 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:17:09.771 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T18:17:09.798 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T18:17:09.861 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-24T18:17:09.998 INFO:tasks.cephadm:Config: {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-24T18:17:09.998 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-24T18:17:10.000 INFO:tasks.cephadm:Cluster fsid is 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:10.000 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-24T18:17:10.000 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.52'} 2026-02-24T18:17:10.000 INFO:tasks.cephadm:First mon is mon.a on trial052 2026-02-24T18:17:10.000 INFO:tasks.cephadm:First mgr is a 2026-02-24T18:17:10.000 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-24T18:17:10.000 DEBUG:teuthology.orchestra.run.trial052:> sudo hostname $(hostname -s) 2026-02-24T18:17:10.026 DEBUG:teuthology.orchestra.run.trial080:> sudo hostname $(hostname -s) 2026-02-24T18:17:10.053 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-24T18:17:10.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-24T18:17:10.204 INFO:tasks.cephadm:builder_project result: [{'url': 'https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/', 'ref': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-22 17:34:30.619694', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '19.2.3-689-gf90f4eae', 'package_manager_version': '19.2.3-689.gf90f4eae', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3182/', 'root_build_cause': '', 'node_name': '10.20.192.96+toko06', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-24T18:17:10.368 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-yuri6-testing-2026-02-22-1629-squid, sha1 f90f4eaebb28b619cf76e80cbbe997656da69579 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-24T18:17:10.369 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/x86_64/flavors/default/cephadm 2026-02-24T18:17:10.369 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/x86_64/flavors/default/cephadm 2026-02-24T18:17:10.369 DEBUG:teuthology.orchestra.run.trial052:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T18:17:11.674 INFO:teuthology.orchestra.run.trial052.stdout:-rw-r--r--. 1 ubuntu ubuntu 788278 Feb 24 18:17 /home/ubuntu/cephtest/cephadm 2026-02-24T18:17:11.675 DEBUG:teuthology.orchestra.run.trial080:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T18:17:12.626 INFO:teuthology.orchestra.run.trial080.stdout:-rw-r--r--. 1 ubuntu ubuntu 788278 Feb 24 18:17 /home/ubuntu/cephtest/cephadm 2026-02-24T18:17:12.626 DEBUG:teuthology.orchestra.run.trial052:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T18:17:12.644 DEBUG:teuthology.orchestra.run.trial080:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T18:17:12.672 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 on all hosts... 2026-02-24T18:17:12.672 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 pull 2026-02-24T18:17:12.687 DEBUG:teuthology.orchestra.run.trial080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 pull 2026-02-24T18:17:12.831 INFO:teuthology.orchestra.run.trial052.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579... 2026-02-24T18:17:12.852 INFO:teuthology.orchestra.run.trial080.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579... 2026-02-24T18:17:31.769 INFO:teuthology.orchestra.run.trial080.stdout:{ 2026-02-24T18:17:31.769 INFO:teuthology.orchestra.run.trial080.stdout: "ceph_version": "ceph version 19.2.3-689-gf90f4eae (f90f4eaebb28b619cf76e80cbbe997656da69579) squid (stable)", 2026-02-24T18:17:31.769 INFO:teuthology.orchestra.run.trial080.stdout: "image_id": "75b49c75e8d334c838043815164b4119ae90a517115b7788c8837259804ff753", 2026-02-24T18:17:31.770 INFO:teuthology.orchestra.run.trial080.stdout: "repo_digests": [ 2026-02-24T18:17:31.770 INFO:teuthology.orchestra.run.trial080.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:fe7701edd04ba4773549264ab987f7cc011b1d4c55845f5183cb7d88f7a2c119" 2026-02-24T18:17:31.770 INFO:teuthology.orchestra.run.trial080.stdout: ] 2026-02-24T18:17:31.770 INFO:teuthology.orchestra.run.trial080.stdout:} 2026-02-24T18:17:31.854 INFO:teuthology.orchestra.run.trial052.stdout:{ 2026-02-24T18:17:31.855 INFO:teuthology.orchestra.run.trial052.stdout: "ceph_version": "ceph version 19.2.3-689-gf90f4eae (f90f4eaebb28b619cf76e80cbbe997656da69579) squid (stable)", 2026-02-24T18:17:31.855 INFO:teuthology.orchestra.run.trial052.stdout: "image_id": "75b49c75e8d334c838043815164b4119ae90a517115b7788c8837259804ff753", 2026-02-24T18:17:31.855 INFO:teuthology.orchestra.run.trial052.stdout: "repo_digests": [ 2026-02-24T18:17:31.855 INFO:teuthology.orchestra.run.trial052.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:fe7701edd04ba4773549264ab987f7cc011b1d4c55845f5183cb7d88f7a2c119" 2026-02-24T18:17:31.855 INFO:teuthology.orchestra.run.trial052.stdout: ] 2026-02-24T18:17:31.855 INFO:teuthology.orchestra.run.trial052.stdout:} 2026-02-24T18:17:31.872 DEBUG:teuthology.orchestra.run.trial052:> sudo mkdir -p /etc/ceph 2026-02-24T18:17:31.956 DEBUG:teuthology.orchestra.run.trial080:> sudo mkdir -p /etc/ceph 2026-02-24T18:17:31.985 DEBUG:teuthology.orchestra.run.trial052:> sudo chmod 777 /etc/ceph 2026-02-24T18:17:32.008 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod 777 /etc/ceph 2026-02-24T18:17:32.050 INFO:tasks.cephadm:Writing seed config... 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [client] debug client = 20 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [client] debug mgrc = 20 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [client] debug ms = 1 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [mds] debug mgrc = 20 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [mgr] debug client = 20 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [osd] debug mgrc = 20 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-24T18:17:32.051 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-24T18:17:32.052 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2026-02-24T18:17:32.052 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-24T18:17:32.052 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-24T18:17:32.052 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-24T18:17:32.052 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-24T18:17:32.052 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-24T18:17:32.052 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:17:32.052 DEBUG:teuthology.orchestra.run.trial052:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-24T18:17:32.068 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 08cedbc6-11ad-11f1-a33f-d404e6e7d460 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug mgrc = 20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug client = 20 debug mgrc = 20 debug ms = 1 [mds] debug mgrc = 20 2026-02-24T18:17:32.068 DEBUG:teuthology.orchestra.run.trial052:mon.a> sudo journalctl -f -n 0 -u ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mon.a.service 2026-02-24T18:17:32.110 DEBUG:teuthology.orchestra.run.trial052:mgr.a> sudo journalctl -f -n 0 -u ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mgr.a.service 2026-02-24T18:17:32.153 INFO:tasks.cephadm:Bootstrapping... 2026-02-24T18:17:32.154 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 -v bootstrap --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.52 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-24T18:17:32.287 INFO:teuthology.orchestra.run.trial052.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:17:32.287 INFO:teuthology.orchestra.run.trial052.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579', '-v', 'bootstrap', '--fsid', '08cedbc6-11ad-11f1-a33f-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.52', '--skip-admin-label'] 2026-02-24T18:17:32.287 INFO:teuthology.orchestra.run.trial052.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-24T18:17:32.288 INFO:teuthology.orchestra.run.trial052.stdout:Verifying podman|docker is present... 2026-02-24T18:17:32.303 INFO:teuthology.orchestra.run.trial052.stdout:/bin/podman: stdout 5.8.0 2026-02-24T18:17:32.303 INFO:teuthology.orchestra.run.trial052.stdout:Verifying lvm2 is present... 2026-02-24T18:17:32.304 INFO:teuthology.orchestra.run.trial052.stdout:Verifying time synchronization is in place... 2026-02-24T18:17:32.310 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T18:17:32.310 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T18:17:32.316 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T18:17:32.316 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout inactive 2026-02-24T18:17:32.322 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout enabled 2026-02-24T18:17:32.328 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout active 2026-02-24T18:17:32.328 INFO:teuthology.orchestra.run.trial052.stdout:Unit chronyd.service is enabled and running 2026-02-24T18:17:32.328 INFO:teuthology.orchestra.run.trial052.stdout:Repeating the final host check... 2026-02-24T18:17:32.343 INFO:teuthology.orchestra.run.trial052.stdout:/bin/podman: stdout 5.8.0 2026-02-24T18:17:32.343 INFO:teuthology.orchestra.run.trial052.stdout:podman (/bin/podman) version 5.8.0 is present 2026-02-24T18:17:32.343 INFO:teuthology.orchestra.run.trial052.stdout:systemctl is present 2026-02-24T18:17:32.343 INFO:teuthology.orchestra.run.trial052.stdout:lvcreate is present 2026-02-24T18:17:32.348 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T18:17:32.348 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T18:17:32.354 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T18:17:32.354 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout inactive 2026-02-24T18:17:32.360 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout enabled 2026-02-24T18:17:32.365 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout active 2026-02-24T18:17:32.365 INFO:teuthology.orchestra.run.trial052.stdout:Unit chronyd.service is enabled and running 2026-02-24T18:17:32.365 INFO:teuthology.orchestra.run.trial052.stdout:Host looks OK 2026-02-24T18:17:32.366 INFO:teuthology.orchestra.run.trial052.stdout:Cluster fsid: 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:32.366 INFO:teuthology.orchestra.run.trial052.stdout:Acquiring lock 140204979007792 on /run/cephadm/08cedbc6-11ad-11f1-a33f-d404e6e7d460.lock 2026-02-24T18:17:32.366 INFO:teuthology.orchestra.run.trial052.stdout:Lock 140204979007792 acquired on /run/cephadm/08cedbc6-11ad-11f1-a33f-d404e6e7d460.lock 2026-02-24T18:17:32.366 INFO:teuthology.orchestra.run.trial052.stdout:Verifying IP 10.20.193.52 port 3300 ... 2026-02-24T18:17:32.366 INFO:teuthology.orchestra.run.trial052.stdout:Verifying IP 10.20.193.52 port 6789 ... 2026-02-24T18:17:32.366 INFO:teuthology.orchestra.run.trial052.stdout:Base mon IP(s) is [10.20.193.52:3300, 10.20.193.52:6789], mon addrv is [v2:10.20.193.52:3300,v1:10.20.193.52:6789] 2026-02-24T18:17:32.369 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.52 metric 102 2026-02-24T18:17:32.369 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.52 metric 102 2026-02-24T18:17:32.369 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-24T18:17:32.372 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-24T18:17:32.372 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-24T18:17:32.372 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-24T18:17:32.375 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout inet6 fe80::1d63:ef8c:e267:aaae/64 scope link noprefixroute 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:62ba/64 scope link 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:Mon IP `10.20.193.52` is in CIDR network `10.20.192.0/20` 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:Mon IP `10.20.193.52` is in CIDR network `10.20.192.0/20` 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-24T18:17:32.376 INFO:teuthology.orchestra.run.trial052.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-24T18:17:32.377 INFO:teuthology.orchestra.run.trial052.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579... 2026-02-24T18:17:32.615 INFO:teuthology.orchestra.run.trial052.stdout:/bin/podman: stdout 75b49c75e8d334c838043815164b4119ae90a517115b7788c8837259804ff753 2026-02-24T18:17:32.616 INFO:teuthology.orchestra.run.trial052.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579... 2026-02-24T18:17:32.616 INFO:teuthology.orchestra.run.trial052.stdout:/bin/podman: stderr Getting image source signatures 2026-02-24T18:17:32.616 INFO:teuthology.orchestra.run.trial052.stdout:/bin/podman: stderr Copying blob sha256:0f773c1b64a38c7e022f7602aaefc109424204feea80a6be7ec4aec5383d29d7 2026-02-24T18:17:32.616 INFO:teuthology.orchestra.run.trial052.stdout:/bin/podman: stderr Copying blob sha256:5dd85e1a50663785d86adae5ef92579a03e6f64059ca9c005010518acdd62048 2026-02-24T18:17:32.616 INFO:teuthology.orchestra.run.trial052.stdout:/bin/podman: stderr Copying config sha256:75b49c75e8d334c838043815164b4119ae90a517115b7788c8837259804ff753 2026-02-24T18:17:32.616 INFO:teuthology.orchestra.run.trial052.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-24T18:17:32.737 INFO:teuthology.orchestra.run.trial052.stdout:ceph: stdout ceph version 19.2.3-689-gf90f4eae (f90f4eaebb28b619cf76e80cbbe997656da69579) squid (stable) 2026-02-24T18:17:32.737 INFO:teuthology.orchestra.run.trial052.stdout:Ceph version: ceph version 19.2.3-689-gf90f4eae (f90f4eaebb28b619cf76e80cbbe997656da69579) squid (stable) 2026-02-24T18:17:32.737 INFO:teuthology.orchestra.run.trial052.stdout:Extracting ceph user uid/gid from container image... 2026-02-24T18:17:32.889 INFO:teuthology.orchestra.run.trial052.stdout:stat: stdout 167 167 2026-02-24T18:17:32.890 INFO:teuthology.orchestra.run.trial052.stdout:Creating initial keys... 2026-02-24T18:17:33.032 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph-authtool: stdout AQA9651pdYAZARAANORRumB15twem9Hj3vDeHA== 2026-02-24T18:17:33.162 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph-authtool: stdout AQA9651pbIbcCBAAypXsmEXX2NzVBWvxvYIHRQ== 2026-02-24T18:17:33.301 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph-authtool: stdout AQA9651pyWYkERAASChx0+R05YNDVCffeY5+3Q== 2026-02-24T18:17:33.302 INFO:teuthology.orchestra.run.trial052.stdout:Creating initial monmap... 2026-02-24T18:17:33.432 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T18:17:33.432 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-24T18:17:33.432 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:33.433 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T18:17:33.433 INFO:teuthology.orchestra.run.trial052.stdout:monmaptool for a [v2:10.20.193.52:3300,v1:10.20.193.52:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T18:17:33.433 INFO:teuthology.orchestra.run.trial052.stdout:setting min_mon_release = quincy 2026-02-24T18:17:33.433 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/monmaptool: set fsid to 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:33.433 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T18:17:33.433 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:33.433 INFO:teuthology.orchestra.run.trial052.stdout:Creating mon... 2026-02-24T18:17:33.575 INFO:teuthology.orchestra.run.trial052.stdout:create mon.a on 2026-02-24T18:17:33.740 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-24T18:17:33.841 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-24T18:17:33.953 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460.target → /etc/systemd/system/ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460.target. 2026-02-24T18:17:33.954 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460.target → /etc/systemd/system/ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460.target. 2026-02-24T18:17:34.077 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mon.a 2026-02-24T18:17:34.078 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stderr Failed to reset failed state of unit ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mon.a.service: Unit ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mon.a.service not loaded. 2026-02-24T18:17:34.206 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460.target.wants/ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@.service. 2026-02-24T18:17:34.341 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T18:17:34.342 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout disabled 2026-02-24T18:17:34.348 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T18:17:34.348 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout inactive 2026-02-24T18:17:34.348 INFO:teuthology.orchestra.run.trial052.stdout:firewalld.service is not enabled 2026-02-24T18:17:34.348 INFO:teuthology.orchestra.run.trial052.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T18:17:34.348 INFO:teuthology.orchestra.run.trial052.stdout:Waiting for mon to start... 2026-02-24T18:17:34.348 INFO:teuthology.orchestra.run.trial052.stdout:Waiting for mon... 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout cluster: 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout id: 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout services: 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.135549s) 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout data: 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout pgs: 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.451+0000 7fd6060fd640 1 Processor -- start 2026-02-24T18:17:34.514 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.451+0000 7fd6060fd640 1 -- start start 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.451+0000 7fd6060fd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd600109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.451+0000 7fd6060fd640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd600109b50 con 0x7fd600109180 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.451+0000 7fd5ff7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd600109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.451+0000 7fd5ff7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd600109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:53270/0 (socket says 10.20.193.52:53270) 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.451+0000 7fd5ff7fe640 1 -- 10.20.193.52:0/1621170038 learned_addr learned my addr 10.20.193.52:0/1621170038 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.451+0000 7fd5ff7fe640 1 -- 10.20.193.52:0/1621170038 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60010a2c0 con 0x7fd600109180 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd5ff7fe640 1 --2- 10.20.193.52:0/1621170038 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd600109580 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009920 tx=0x7fd5ec02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9a3b326ee252f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd5fe7fc640 1 -- 10.20.193.52:0/1621170038 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5ec03c070 con 0x7fd600109180 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd5fe7fc640 1 -- 10.20.193.52:0/1621170038 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec02fae0 con 0x7fd600109180 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd5fe7fc640 1 -- 10.20.193.52:0/1621170038 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5ec02fde0 con 0x7fd600109180 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd6060fd640 1 -- 10.20.193.52:0/1621170038 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 msgr2=0x7fd600109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd6060fd640 1 --2- 10.20.193.52:0/1621170038 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd600109580 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009920 tx=0x7fd5ec02ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd6060fd640 1 -- 10.20.193.52:0/1621170038 shutdown_connections 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd6060fd640 1 --2- 10.20.193.52:0/1621170038 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd600109580 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd6060fd640 1 -- 10.20.193.52:0/1621170038 >> 10.20.193.52:0/1621170038 conn(0x7fd60007c830 msgr2=0x7fd600107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd6060fd640 1 -- 10.20.193.52:0/1621170038 shutdown_connections 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd6060fd640 1 -- 10.20.193.52:0/1621170038 wait complete. 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd6060fd640 1 Processor -- start 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.453+0000 7fd6060fd640 1 -- start start 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd6060fd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd60019ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd6060fd640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd60010a7f0 con 0x7fd600109180 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5ff7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd60019ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:34.515 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5ff7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd60019ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:53282/0 (socket says 10.20.193.52:53282) 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5ff7fe640 1 -- 10.20.193.52:0/977334687 learned_addr learned my addr 10.20.193.52:0/977334687 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5ff7fe640 1 -- 10.20.193.52:0/977334687 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60019efa0 con 0x7fd600109180 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5ff7fe640 1 --2- 10.20.193.52:0/977334687 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd60019ea60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009a50 tx=0x7fd5ec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5fcff9640 1 -- 10.20.193.52:0/977334687 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5ec03c050 con 0x7fd600109180 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5fcff9640 1 -- 10.20.193.52:0/977334687 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec048070 con 0x7fd600109180 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd6060fd640 1 -- 10.20.193.52:0/977334687 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60019f230 con 0x7fd600109180 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5fcff9640 1 -- 10.20.193.52:0/977334687 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5ec043710 con 0x7fd600109180 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd6060fd640 1 -- 10.20.193.52:0/977334687 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6001a1f20 con 0x7fd600109180 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5fcff9640 1 -- 10.20.193.52:0/977334687 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fd5ec02fa90 con 0x7fd600109180 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5fcff9640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5fcff9640 4 mgrc handle_mgr_map Got map version 1 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5fcff9640 4 mgrc handle_mgr_map Active mgr is now 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5fcff9640 4 mgrc reconnect No active mgr available yet 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.454+0000 7fd5fcff9640 1 -- 10.20.193.52:0/977334687 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd5ec04d710 con 0x7fd600109180 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.455+0000 7fd6060fd640 1 -- 10.20.193.52:0/977334687 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60010ae40 con 0x7fd600109180 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.456+0000 7fd5fcff9640 1 -- 10.20.193.52:0/977334687 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fd5ec052020 con 0x7fd600109180 2026-02-24T18:17:34.516 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.486+0000 7fd6060fd640 1 -- 10.20.193.52:0/977334687 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fd600197d40 con 0x7fd600109180 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.486+0000 7fd5fcff9640 1 -- 10.20.193.52:0/977334687 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fd5ec04d9b0 con 0x7fd600109180 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.487+0000 7fd6060fd640 10 mgrc shutdown 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.487+0000 7fd6060fd640 1 -- 10.20.193.52:0/977334687 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 msgr2=0x7fd60019ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.487+0000 7fd6060fd640 1 --2- 10.20.193.52:0/977334687 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd60019ea60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009a50 tx=0x7fd5ec0047c0 comp rx=0 tx=0).stop 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.487+0000 7fd6060fd640 1 -- 10.20.193.52:0/977334687 shutdown_connections 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.487+0000 7fd6060fd640 1 --2- 10.20.193.52:0/977334687 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd600109180 0x7fd60019ea60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.487+0000 7fd6060fd640 1 -- 10.20.193.52:0/977334687 >> 10.20.193.52:0/977334687 conn(0x7fd60007c830 msgr2=0x7fd6001954a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.487+0000 7fd6060fd640 1 -- 10.20.193.52:0/977334687 shutdown_connections 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.487+0000 7fd6060fd640 1 -- 10.20.193.52:0/977334687 wait complete. 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:mon is available 2026-02-24T18:17:34.517 INFO:teuthology.orchestra.run.trial052.stdout:Assimilating anything we can from ceph.conf... 2026-02-24T18:17:34.698 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:34.698 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T18:17:34.698 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout fsid = 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:34.699 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T18:17:34.699 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.52:3300,v1:10.20.193.52:6789] 2026-02-24T18:17:34.699 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T18:17:34.699 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T18:17:34.699 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T18:17:34.699 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T18:17:34.699 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:34.699 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T18:17:34.700 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T18:17:34.700 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:34.700 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T18:17:34.700 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-24T18:17:34.700 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-24T18:17:34.700 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-24T18:17:34.700 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T18:17:34.700 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T18:17:34.701 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.616+0000 7facebbf7640 1 Processor -- start 2026-02-24T18:17:34.701 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.616+0000 7facebbf7640 1 -- start start 2026-02-24T18:17:34.701 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.616+0000 7facebbf7640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face4109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:34.701 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.617+0000 7facebbf7640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7face4109b50 con 0x7face4109180 2026-02-24T18:17:34.701 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.617+0000 7face996c640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face4109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:34.701 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.617+0000 7face996c640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face4109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:53292/0 (socket says 10.20.193.52:53292) 2026-02-24T18:17:34.701 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.617+0000 7face996c640 1 -- 10.20.193.52:0/453977433 learned_addr learned my addr 10.20.193.52:0/453977433 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:34.702 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.617+0000 7face996c640 1 -- 10.20.193.52:0/453977433 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face410a2c0 con 0x7face4109180 2026-02-24T18:17:34.702 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.617+0000 7face996c640 1 --2- 10.20.193.52:0/453977433 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face4109580 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7facd4009920 tx=0x7facd402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4111a8ded885b39 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:34.702 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.617+0000 7face896a640 1 -- 10.20.193.52:0/453977433 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd403c070 con 0x7face4109180 2026-02-24T18:17:34.702 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7face896a640 1 -- 10.20.193.52:0/453977433 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd402fae0 con 0x7face4109180 2026-02-24T18:17:34.702 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7face896a640 1 -- 10.20.193.52:0/453977433 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd402fde0 con 0x7face4109180 2026-02-24T18:17:34.702 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 -- 10.20.193.52:0/453977433 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 msgr2=0x7face4109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:34.702 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 --2- 10.20.193.52:0/453977433 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face4109580 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7facd4009920 tx=0x7facd402ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:34.702 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 -- 10.20.193.52:0/453977433 shutdown_connections 2026-02-24T18:17:34.703 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 --2- 10.20.193.52:0/453977433 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face4109580 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:34.703 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 -- 10.20.193.52:0/453977433 >> 10.20.193.52:0/453977433 conn(0x7face407c830 msgr2=0x7face4107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:34.703 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 -- 10.20.193.52:0/453977433 shutdown_connections 2026-02-24T18:17:34.703 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 -- 10.20.193.52:0/453977433 wait complete. 2026-02-24T18:17:34.703 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 Processor -- start 2026-02-24T18:17:34.703 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 -- start start 2026-02-24T18:17:34.703 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face419ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:34.703 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7facebbf7640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7face410a7f0 con 0x7face4109180 2026-02-24T18:17:34.704 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7face996c640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face419ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:34.704 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7face996c640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face419ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:53296/0 (socket says 10.20.193.52:53296) 2026-02-24T18:17:34.704 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.618+0000 7face996c640 1 -- 10.20.193.52:0/68661515 learned_addr learned my addr 10.20.193.52:0/68661515 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:34.704 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7face996c640 1 -- 10.20.193.52:0/68661515 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face419efa0 con 0x7face4109180 2026-02-24T18:17:34.704 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7face996c640 1 --2- 10.20.193.52:0/68661515 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face419ea60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7facd4009a50 tx=0x7facd40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:34.704 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facd2ffd640 1 -- 10.20.193.52:0/68661515 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd403c050 con 0x7face4109180 2026-02-24T18:17:34.704 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facd2ffd640 1 -- 10.20.193.52:0/68661515 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd4048070 con 0x7face4109180 2026-02-24T18:17:34.704 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facebbf7640 1 -- 10.20.193.52:0/68661515 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face419f230 con 0x7face4109180 2026-02-24T18:17:34.705 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facd2ffd640 1 -- 10.20.193.52:0/68661515 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facd4043710 con 0x7face4109180 2026-02-24T18:17:34.705 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facebbf7640 1 -- 10.20.193.52:0/68661515 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face41a1f20 con 0x7face4109180 2026-02-24T18:17:34.705 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facd2ffd640 1 -- 10.20.193.52:0/68661515 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7facd40438b0 con 0x7face4109180 2026-02-24T18:17:34.705 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facd2ffd640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-24T18:17:34.705 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facd2ffd640 4 mgrc handle_mgr_map Got map version 1 2026-02-24T18:17:34.705 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facd2ffd640 4 mgrc handle_mgr_map Active mgr is now 2026-02-24T18:17:34.705 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facd2ffd640 4 mgrc reconnect No active mgr available yet 2026-02-24T18:17:34.705 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facd2ffd640 1 -- 10.20.193.52:0/68661515 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7facd404dc70 con 0x7face4109180 2026-02-24T18:17:34.706 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.619+0000 7facebbf7640 1 -- 10.20.193.52:0/68661515 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face410ae40 con 0x7face4109180 2026-02-24T18:17:34.706 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.620+0000 7facd2ffd640 1 -- 10.20.193.52:0/68661515 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7facd4043d60 con 0x7face4109180 2026-02-24T18:17:34.706 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.648+0000 7facebbf7640 1 -- 10.20.193.52:0/68661515 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7face406bf90 con 0x7face4109180 2026-02-24T18:17:34.706 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.650+0000 7facd2ffd640 1 -- 10.20.193.52:0/68661515 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7facd404d460 con 0x7face4109180 2026-02-24T18:17:34.706 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.650+0000 7facebbf7640 10 mgrc shutdown 2026-02-24T18:17:34.706 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.650+0000 7facebbf7640 1 -- 10.20.193.52:0/68661515 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 msgr2=0x7face419ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:34.706 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.650+0000 7facebbf7640 1 --2- 10.20.193.52:0/68661515 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face419ea60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7facd4009a50 tx=0x7facd40047c0 comp rx=0 tx=0).stop 2026-02-24T18:17:34.706 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.650+0000 7facebbf7640 1 -- 10.20.193.52:0/68661515 shutdown_connections 2026-02-24T18:17:34.707 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.650+0000 7facebbf7640 1 --2- 10.20.193.52:0/68661515 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7face4109180 0x7face419ea60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:34.707 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.650+0000 7facebbf7640 1 -- 10.20.193.52:0/68661515 >> 10.20.193.52:0/68661515 conn(0x7face407c830 msgr2=0x7face41954a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:34.707 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.650+0000 7facebbf7640 1 -- 10.20.193.52:0/68661515 shutdown_connections 2026-02-24T18:17:34.707 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.650+0000 7facebbf7640 1 -- 10.20.193.52:0/68661515 wait complete. 2026-02-24T18:17:34.707 INFO:teuthology.orchestra.run.trial052.stdout:Generating new minimal ceph.conf... 2026-02-24T18:17:34.862 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.786+0000 7fc62d230640 1 Processor -- start 2026-02-24T18:17:34.862 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.786+0000 7fc62d230640 1 -- start start 2026-02-24T18:17:34.862 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.786+0000 7fc62d230640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc628107260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:34.862 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.786+0000 7fc62d230640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc6281077a0 con 0x7fc628106e60 2026-02-24T18:17:34.863 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.786+0000 7fc626d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc628107260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:34.863 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.786+0000 7fc626d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc628107260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:53306/0 (socket says 10.20.193.52:53306) 2026-02-24T18:17:34.863 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.786+0000 7fc626d76640 1 -- 10.20.193.52:0/2612300052 learned_addr learned my addr 10.20.193.52:0/2612300052 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:34.863 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.786+0000 7fc626d76640 1 -- 10.20.193.52:0/2612300052 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc628107fc0 con 0x7fc628106e60 2026-02-24T18:17:34.863 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc626d76640 1 --2- 10.20.193.52:0/2612300052 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc628107260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009920 tx=0x7fc61c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86aec8395efd612b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:34.863 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc625d74640 1 -- 10.20.193.52:0/2612300052 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61c03c070 con 0x7fc628106e60 2026-02-24T18:17:34.863 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc625d74640 1 -- 10.20.193.52:0/2612300052 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fc61c037440 con 0x7fc628106e60 2026-02-24T18:17:34.864 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc625d74640 1 -- 10.20.193.52:0/2612300052 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61c035340 con 0x7fc628106e60 2026-02-24T18:17:34.864 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc62d230640 1 -- 10.20.193.52:0/2612300052 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 msgr2=0x7fc628107260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:34.864 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc62d230640 1 --2- 10.20.193.52:0/2612300052 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc628107260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009920 tx=0x7fc61c02ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:34.864 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc62d230640 1 -- 10.20.193.52:0/2612300052 shutdown_connections 2026-02-24T18:17:34.864 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc62d230640 1 --2- 10.20.193.52:0/2612300052 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc628107260 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:34.864 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc62d230640 1 -- 10.20.193.52:0/2612300052 >> 10.20.193.52:0/2612300052 conn(0x7fc628102610 msgr2=0x7fc628104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:34.864 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc62d230640 1 -- 10.20.193.52:0/2612300052 shutdown_connections 2026-02-24T18:17:34.864 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.787+0000 7fc62d230640 1 -- 10.20.193.52:0/2612300052 wait complete. 2026-02-24T18:17:34.865 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc62d230640 1 Processor -- start 2026-02-24T18:17:34.865 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc62d230640 1 -- start start 2026-02-24T18:17:34.865 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc62d230640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc62819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:34.865 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc62d230640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc62810b280 con 0x7fc628106e60 2026-02-24T18:17:34.865 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc626d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc62819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:34.865 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc626d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc62819cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:53314/0 (socket says 10.20.193.52:53314) 2026-02-24T18:17:34.865 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc626d76640 1 -- 10.20.193.52:0/418214047 learned_addr learned my addr 10.20.193.52:0/418214047 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:34.865 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc626d76640 1 -- 10.20.193.52:0/418214047 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62819d450 con 0x7fc628106e60 2026-02-24T18:17:34.866 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc626d76640 1 --2- 10.20.193.52:0/418214047 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc62819cf10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc61c006fd0 tx=0x7fc61c037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:34.866 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc607fff640 1 -- 10.20.193.52:0/418214047 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61c045070 con 0x7fc628106e60 2026-02-24T18:17:34.866 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc607fff640 1 -- 10.20.193.52:0/418214047 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fc61c040450 con 0x7fc628106e60 2026-02-24T18:17:34.866 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc62d230640 1 -- 10.20.193.52:0/418214047 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62819d6e0 con 0x7fc628106e60 2026-02-24T18:17:34.866 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc607fff640 1 -- 10.20.193.52:0/418214047 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61c03c070 con 0x7fc628106e60 2026-02-24T18:17:34.866 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc62d230640 1 -- 10.20.193.52:0/418214047 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6281a03d0 con 0x7fc628106e60 2026-02-24T18:17:34.866 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc607fff640 1 -- 10.20.193.52:0/418214047 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc61c04a440 con 0x7fc628106e60 2026-02-24T18:17:34.866 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc607fff640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-24T18:17:34.867 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc607fff640 4 mgrc handle_mgr_map Got map version 1 2026-02-24T18:17:34.867 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc607fff640 4 mgrc handle_mgr_map Active mgr is now 2026-02-24T18:17:34.867 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc607fff640 4 mgrc reconnect No active mgr available yet 2026-02-24T18:17:34.867 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.788+0000 7fc607fff640 1 -- 10.20.193.52:0/418214047 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc61c049960 con 0x7fc628106e60 2026-02-24T18:17:34.867 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.789+0000 7fc62d230640 1 -- 10.20.193.52:0/418214047 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6281072e0 con 0x7fc628106e60 2026-02-24T18:17:34.867 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.790+0000 7fc607fff640 1 -- 10.20.193.52:0/418214047 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fc61c037440 con 0x7fc628106e60 2026-02-24T18:17:34.867 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.817+0000 7fc62d230640 1 -- 10.20.193.52:0/418214047 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc6281964e0 con 0x7fc628106e60 2026-02-24T18:17:34.867 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.817+0000 7fc607fff640 1 -- 10.20.193.52:0/418214047 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fc61c040600 con 0x7fc628106e60 2026-02-24T18:17:34.868 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.817+0000 7fc62d230640 10 mgrc shutdown 2026-02-24T18:17:34.868 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.817+0000 7fc62d230640 1 -- 10.20.193.52:0/418214047 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 msgr2=0x7fc62819cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:34.868 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.817+0000 7fc62d230640 1 --2- 10.20.193.52:0/418214047 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc62819cf10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc61c006fd0 tx=0x7fc61c037b70 comp rx=0 tx=0).stop 2026-02-24T18:17:34.868 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.817+0000 7fc62d230640 1 -- 10.20.193.52:0/418214047 shutdown_connections 2026-02-24T18:17:34.868 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.817+0000 7fc62d230640 1 --2- 10.20.193.52:0/418214047 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc628106e60 0x7fc62819cf10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:34.868 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.817+0000 7fc62d230640 1 -- 10.20.193.52:0/418214047 >> 10.20.193.52:0/418214047 conn(0x7fc628102610 msgr2=0x7fc628103260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:34.868 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.817+0000 7fc62d230640 1 -- 10.20.193.52:0/418214047 shutdown_connections 2026-02-24T18:17:34.868 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:34.817+0000 7fc62d230640 1 -- 10.20.193.52:0/418214047 wait complete. 2026-02-24T18:17:34.869 INFO:teuthology.orchestra.run.trial052.stdout:Restarting the monitor... 2026-02-24T18:17:35.172 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:34 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mon-a[39000]: 2026-02-24T18:17:34.937+0000 7fcafa7fd640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T18:17:35.348 INFO:teuthology.orchestra.run.trial052.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 podman[39290]: 2026-02-24 18:17:35.17108332 +0000 UTC m=+0.244897027 container died 06ed38a51076a3391946515fe1e9a5e721e7bd8ebdbe3437ef0e35ac9405dc89 (image=quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579, name=ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_SHA1=f90f4eaebb28b619cf76e80cbbe997656da69579, org.label-schema.vendor=CentOS, CEPH_REF=wip-yuri6-testing-2026-02-22-1629-squid, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0) 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 podman[39290]: 2026-02-24 18:17:35.178437478 +0000 UTC m=+0.252251175 container remove 06ed38a51076a3391946515fe1e9a5e721e7bd8ebdbe3437ef0e35ac9405dc89 (image=quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579, name=ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mon-a, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_REF=wip-yuri6-testing-2026-02-22-1629-squid, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f90f4eaebb28b619cf76e80cbbe997656da69579, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 bash[39290]: ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mon-a 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 systemd[1]: ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 systemd[1]: Stopped Ceph mon.a for 08cedbc6-11ad-11f1-a33f-d404e6e7d460. 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 systemd[1]: Starting Ceph mon.a for 08cedbc6-11ad-11f1-a33f-d404e6e7d460... 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 podman[39417]: 2026-02-24 18:17:35.310423722 +0000 UTC m=+0.014092611 container create 837798242c0f7c46adfd2680dcc8f59811bd2ad4807c05fd63c4f8e417ecc300 (image=quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579, name=ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_REF=wip-yuri6-testing-2026-02-22-1629-squid, CEPH_SHA1=f90f4eaebb28b619cf76e80cbbe997656da69579, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216) 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 podman[39417]: 2026-02-24 18:17:35.339179284 +0000 UTC m=+0.042848172 container init 837798242c0f7c46adfd2680dcc8f59811bd2ad4807c05fd63c4f8e417ecc300 (image=quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579, name=ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mon-a, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_SHA1=f90f4eaebb28b619cf76e80cbbe997656da69579, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-yuri6-testing-2026-02-22-1629-squid) 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 podman[39417]: 2026-02-24 18:17:35.341506147 +0000 UTC m=+0.045175035 container start 837798242c0f7c46adfd2680dcc8f59811bd2ad4807c05fd63c4f8e417ecc300 (image=quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579, name=ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-yuri6-testing-2026-02-22-1629-squid, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, CEPH_SHA1=f90f4eaebb28b619cf76e80cbbe997656da69579, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 bash[39417]: 837798242c0f7c46adfd2680dcc8f59811bd2ad4807c05fd63c4f8e417ecc300 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 podman[39417]: 2026-02-24 18:17:35.304631737 +0000 UTC m=+0.008300625 image pull 75b49c75e8d334c838043815164b4119ae90a517115b7788c8837259804ff753 quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 systemd[1]: Started Ceph mon.a for 08cedbc6-11ad-11f1-a33f-d404e6e7d460. 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: set uid:gid to 167:167 (ceph:ceph) 2026-02-24T18:17:35.449 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: ceph version 19.2.3-689-gf90f4eae (f90f4eaebb28b619cf76e80cbbe997656da69579) squid (stable), process ceph-mon, pid 2 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: pidfile_write: ignore empty --pid-file 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: load: jerasure load: lrc 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: RocksDB version: 7.9.2 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Git sha 0 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Compile date 2026-02-22 16:52:59 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: DB SUMMARY 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: DB Session ID: 84J130EZOK2G6LG5L8UR 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: CURRENT file: CURRENT 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: IDENTITY file: IDENTITY 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 82615 ; 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.error_if_exists: 0 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.create_if_missing: 0 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.paranoid_checks: 1 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.env: 0x563a51d5fdc0 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.fs: PosixFileSystem 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.info_log: 0x563a53a07880 2026-02-24T18:17:35.450 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_file_opening_threads: 16 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.statistics: (nil) 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.use_fsync: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_log_file_size: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.keep_log_file_num: 1000 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.recycle_log_file_num: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.allow_fallocate: 1 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.allow_mmap_reads: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.allow_mmap_writes: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.use_direct_reads: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.create_missing_column_families: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.db_log_dir: 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.wal_dir: 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-24T18:17:35.451 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.advise_random_on_open: 1 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.db_write_buffer_size: 0 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.write_buffer_manager: 0x563a53a0b900 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.rate_limiter: (nil) 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.wal_recovery_mode: 2 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.enable_thread_tracking: 0 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.enable_pipelined_write: 0 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.unordered_write: 0 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.row_cache: None 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.wal_filter: None 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.allow_ingest_behind: 0 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.two_write_queues: 0 2026-02-24T18:17:35.452 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.manual_wal_flush: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.wal_compression: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.atomic_flush: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.log_readahead_size: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.best_efforts_recovery: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.allow_data_in_errors: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.db_host_id: __hostname__ 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_background_jobs: 2 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_background_compactions: -1 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_subcompactions: 1 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_total_wal_size: 0 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-24T18:17:35.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_open_files: -1 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bytes_per_sync: 0 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_readahead_size: 0 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_background_flushes: -1 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Compression algorithms supported: 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: kZSTD supported: 0 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: kXpressCompression supported: 0 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: kBZip2Compression supported: 0 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: kLZ4Compression supported: 1 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: kZlibCompression supported: 1 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: kLZ4HCCompression supported: 1 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: kSnappyCompression supported: 1 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-24T18:17:35.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.merge_operator: 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_filter: None 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_filter_factory: None 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.sst_partitioner_factory: None 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563a53a06480) 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout: cache_index_and_filter_blocks: 1 2026-02-24T18:17:35.455 INFO:journalctl@ceph.mon.a.trial052.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: pin_top_level_index_and_filter: 1 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: index_type: 0 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: data_block_index_type: 0 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: index_shortening: 1 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: checksum: 4 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: no_block_cache: 0 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: block_cache: 0x563a53a2b350 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: block_cache_name: BinnedLRUCache 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: block_cache_options: 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: capacity : 536870912 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: num_shard_bits : 4 2026-02-24T18:17:35.456 INFO:journalctl@ceph.mon.a.trial052.stdout: strict_capacity_limit : 0 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: high_pri_pool_ratio: 0.000 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: block_cache_compressed: (nil) 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: persistent_cache: (nil) 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: block_size: 4096 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: block_size_deviation: 10 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: block_restart_interval: 16 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: index_block_restart_interval: 1 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: metadata_block_size: 4096 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: partition_filters: 0 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: use_delta_encoding: 1 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: filter_policy: bloomfilter 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: whole_key_filtering: 1 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: verify_compression: 0 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: read_amp_bytes_per_bit: 0 2026-02-24T18:17:35.457 INFO:journalctl@ceph.mon.a.trial052.stdout: format_version: 5 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout: enable_index_compression: 1 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout: block_align: 0 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout: max_auto_readahead_size: 262144 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout: prepopulate_block_cache: 0 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout: initial_auto_readahead_size: 8192 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout: num_file_reads_for_auto_readahead: 2 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.write_buffer_size: 33554432 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_write_buffer_number: 2 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compression: NoCompression 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bottommost_compression: Disabled 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.prefix_extractor: nullptr 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.num_levels: 7 2026-02-24T18:17:35.458 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compression_opts.level: 32767 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compression_opts.strategy: 0 2026-02-24T18:17:35.459 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compression_opts.enabled: false 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.target_file_size_base: 67108864 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-24T18:17:35.460 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.arena_block_size: 1048576 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.disable_auto_compactions: 0 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-24T18:17:35.461 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.inplace_update_support: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.bloom_locality: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.max_successive_merges: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.paranoid_file_checks: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.force_consistency_checks: 1 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.report_bg_io_stats: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.ttl: 2592000 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-24T18:17:35.462 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.enable_blob_files: false 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.min_blob_size: 0 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.blob_file_size: 268435456 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.blob_file_starting_level: 0 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ff00e0cd-8922-4954-af9f-c1cfb49b6698 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771957055359144, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-24T18:17:35.463 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771957055359900, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 78960, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 257, "table_properties": {"data_size": 77137, "index_size": 208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11439, "raw_average_key_size": 50, "raw_value_size": 70880, "raw_average_value_size": 310, "num_data_blocks": 9, "num_entries": 228, "num_filter_entries": 228, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771957055, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ff00e0cd-8922-4954-af9f-c1cfb49b6698", "db_session_id": "84J130EZOK2G6LG5L8UR", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771957055359966, "job": 1, "event": "recovery_finished"} 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563a53a2ce00 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: DB pointer 0x563a53b38000 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: ** DB Stats ** 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: ** Compaction Stats [default] ** 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: L0 2/0 78.97 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: Sum 2/0 78.97 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T18:17:35.464 INFO:journalctl@ceph.mon.a.trial052.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: ** Compaction Stats [default] ** 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 137.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: Cumulative compaction: 0.00 GB write, 27.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: Interval compaction: 0.00 GB write, 27.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: Block cache BinnedLRUCache@0x563a53a2b350#2 capacity: 512.00 MB usage: 1.16 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.39 KB,7.45058e-05%) Misc(1,0.00 KB,0%) 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: 2026-02-24T18:17:35.465 INFO:journalctl@ceph.mon.a.trial052.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: starting mon.a rank 0 at public addrs [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] at bind addrs [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: mon.a@-1(???) e1 preinit fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: mon.a@-1(???).mds e1 new map 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: mon.a@-1(???).mds e1 print_map 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout: e1 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout: btime 2026-02-24T18:17:34:352712+0000 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout: legacy client fscid: -1 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout: 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout: No filesystems configured 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: monmap epoch 1 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: last_changed 2026-02-24T18:17:33.409612+0000 2026-02-24T18:17:35.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: created 2026-02-24T18:17:33.409612+0000 2026-02-24T18:17:35.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: min_mon_release 19 (squid) 2026-02-24T18:17:35.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: election_strategy: 1 2026-02-24T18:17:35.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: 0: [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] mon.a 2026-02-24T18:17:35.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: fsmap 2026-02-24T18:17:35.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: osdmap e1: 0 total, 0 up, 0 in 2026-02-24T18:17:35.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:35 trial052 ceph-mon[39446]: mgrmap e1: no daemons active 2026-02-24T18:17:35.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.445+0000 7f4172fd5640 1 Processor -- start 2026-02-24T18:17:35.502 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.445+0000 7f4172fd5640 1 -- start start 2026-02-24T18:17:35.502 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.445+0000 7f4172fd5640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c1094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:35.502 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.445+0000 7f4172fd5640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f416c109aa0 con 0x7f416c1090d0 2026-02-24T18:17:35.502 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.445+0000 7f4170d4a640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c1094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:35.502 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.445+0000 7f4170d4a640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c1094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56582/0 (socket says 10.20.193.52:56582) 2026-02-24T18:17:35.502 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.445+0000 7f4170d4a640 1 -- 10.20.193.52:0/1409364240 learned_addr learned my addr 10.20.193.52:0/1409364240 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:35.502 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.446+0000 7f4170d4a640 1 -- 10.20.193.52:0/1409364240 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c10a2d0 con 0x7f416c1090d0 2026-02-24T18:17:35.502 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f4170d4a640 1 --2- 10.20.193.52:0/1409364240 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c1094d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f415c009920 tx=0x7f415c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11c6f0aff0e212a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:35.502 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f41637fe640 1 -- 10.20.193.52:0/1409364240 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c03c070 con 0x7f416c1090d0 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f41637fe640 1 -- 10.20.193.52:0/1409364240 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f415c037440 con 0x7f416c1090d0 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f41637fe640 1 -- 10.20.193.52:0/1409364240 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c035340 con 0x7f416c1090d0 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f4172fd5640 1 -- 10.20.193.52:0/1409364240 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 msgr2=0x7f416c1094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f4172fd5640 1 --2- 10.20.193.52:0/1409364240 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c1094d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f415c009920 tx=0x7f415c02ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f4172fd5640 1 -- 10.20.193.52:0/1409364240 shutdown_connections 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f4172fd5640 1 --2- 10.20.193.52:0/1409364240 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c1094d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f4172fd5640 1 -- 10.20.193.52:0/1409364240 >> 10.20.193.52:0/1409364240 conn(0x7f416c07ca50 msgr2=0x7f416c107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f4172fd5640 1 -- 10.20.193.52:0/1409364240 shutdown_connections 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.447+0000 7f4172fd5640 1 -- 10.20.193.52:0/1409364240 wait complete. 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4172fd5640 1 Processor -- start 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4172fd5640 1 -- start start 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4172fd5640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c19f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4172fd5640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f416c10d500 con 0x7f416c1090d0 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4170d4a640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c19f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4170d4a640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c19f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56588/0 (socket says 10.20.193.52:56588) 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4170d4a640 1 -- 10.20.193.52:0/261405040 learned_addr learned my addr 10.20.193.52:0/261405040 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4170d4a640 1 -- 10.20.193.52:0/261405040 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c19f6d0 con 0x7f416c1090d0 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4170d4a640 1 --2- 10.20.193.52:0/261405040 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c19f190 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f415c006fd0 tx=0x7f415c035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4161ffb640 1 -- 10.20.193.52:0/261405040 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c045070 con 0x7f416c1090d0 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4161ffb640 1 -- 10.20.193.52:0/261405040 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f415c040450 con 0x7f416c1090d0 2026-02-24T18:17:35.503 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4172fd5640 1 -- 10.20.193.52:0/261405040 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c19f960 con 0x7f416c1090d0 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4161ffb640 1 -- 10.20.193.52:0/261405040 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c03c070 con 0x7f416c1090d0 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.448+0000 7f4172fd5640 1 -- 10.20.193.52:0/261405040 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c1a2650 con 0x7f416c1090d0 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.449+0000 7f4161ffb640 1 -- 10.20.193.52:0/261405040 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f415c04a440 con 0x7f416c1090d0 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.449+0000 7f4161ffb640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.449+0000 7f4161ffb640 4 mgrc handle_mgr_map Got map version 1 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.449+0000 7f4161ffb640 4 mgrc handle_mgr_map Active mgr is now 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.449+0000 7f4161ffb640 4 mgrc reconnect No active mgr available yet 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.449+0000 7f4161ffb640 1 -- 10.20.193.52:0/261405040 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f415c0499f0 con 0x7f416c1090d0 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.449+0000 7f4172fd5640 1 -- 10.20.193.52:0/261405040 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c19fe40 con 0x7f416c1090d0 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.450+0000 7f4161ffb640 1 -- 10.20.193.52:0/261405040 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f416c19fe40 con 0x7f416c1090d0 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.477+0000 7f4172fd5640 1 -- 10.20.193.52:0/261405040 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f416c198810 con 0x7f416c1090d0 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.478+0000 7f4161ffb640 1 -- 10.20.193.52:0/261405040 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 125+0+0 (secure 0 0 0) 0x7f415c04f030 con 0x7f416c1090d0 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.479+0000 7f4172fd5640 10 mgrc shutdown 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.479+0000 7f4172fd5640 1 -- 10.20.193.52:0/261405040 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 msgr2=0x7f416c19f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.479+0000 7f4172fd5640 1 --2- 10.20.193.52:0/261405040 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c19f190 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f415c006fd0 tx=0x7f415c035f80 comp rx=0 tx=0).stop 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.479+0000 7f4172fd5640 1 -- 10.20.193.52:0/261405040 shutdown_connections 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.479+0000 7f4172fd5640 1 --2- 10.20.193.52:0/261405040 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f416c1090d0 0x7f416c19f190 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.479+0000 7f4172fd5640 1 -- 10.20.193.52:0/261405040 >> 10.20.193.52:0/261405040 conn(0x7f416c07ca50 msgr2=0x7f416c106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.479+0000 7f4172fd5640 1 -- 10.20.193.52:0/261405040 shutdown_connections 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:35.479+0000 7f4172fd5640 1 -- 10.20.193.52:0/261405040 wait complete. 2026-02-24T18:17:35.504 INFO:teuthology.orchestra.run.trial052.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-24T18:17:35.505 INFO:teuthology.orchestra.run.trial052.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-24T18:17:35.505 INFO:teuthology.orchestra.run.trial052.stdout:Creating mgr... 2026-02-24T18:17:35.505 INFO:teuthology.orchestra.run.trial052.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-24T18:17:35.505 INFO:teuthology.orchestra.run.trial052.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-24T18:17:35.636 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mgr.a 2026-02-24T18:17:35.636 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stderr Failed to reset failed state of unit ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mgr.a.service: Unit ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mgr.a.service not loaded. 2026-02-24T18:17:35.751 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460.target.wants/ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@mgr.a.service → /etc/systemd/system/ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@.service. 2026-02-24T18:17:35.897 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T18:17:35.897 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout disabled 2026-02-24T18:17:35.903 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T18:17:35.903 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout inactive 2026-02-24T18:17:35.903 INFO:teuthology.orchestra.run.trial052.stdout:firewalld.service is not enabled 2026-02-24T18:17:35.903 INFO:teuthology.orchestra.run.trial052.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T18:17:35.910 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T18:17:35.910 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout disabled 2026-02-24T18:17:35.916 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T18:17:35.917 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout inactive 2026-02-24T18:17:35.917 INFO:teuthology.orchestra.run.trial052.stdout:firewalld.service is not enabled 2026-02-24T18:17:35.917 INFO:teuthology.orchestra.run.trial052.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-24T18:17:35.917 INFO:teuthology.orchestra.run.trial052.stdout:Waiting for mgr to start... 2026-02-24T18:17:35.917 INFO:teuthology.orchestra.run.trial052.stdout:Waiting for mgr... 2026-02-24T18:17:36.087 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:36.087 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout { 2026-02-24T18:17:36.087 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "fsid": "08cedbc6-11ad-11f1-a33f-d404e6e7d460", 2026-02-24T18:17:36.087 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T18:17:36.087 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 0 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout ], 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout ], 2026-02-24T18:17:36.088 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T18:17:36.089 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T18:17:36.090 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:36.091 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T18:17:36.091 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:36.091 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T18:17:34:352712+0000", 2026-02-24T18:17:36.091 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T18:17:36.091 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T18:17:36.091 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:36.091 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T18:17:36.091 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T18:17:36.091 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T18:17:36.091 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "restful" 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout ], 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T18:17:34.353211+0000", 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T18:17:36.092 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout } 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.022+0000 7f975e6c4640 1 Processor -- start 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.022+0000 7f975e6c4640 1 -- start start 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.022+0000 7f975e6c4640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f9758107210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.022+0000 7f975e6c4640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9758107750 con 0x7f9758106e10 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.022+0000 7f9757fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f9758107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.023+0000 7f9757fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f9758107210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56624/0 (socket says 10.20.193.52:56624) 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.023+0000 7f9757fff640 1 -- 10.20.193.52:0/136755842 learned_addr learned my addr 10.20.193.52:0/136755842 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.023+0000 7f9757fff640 1 -- 10.20.193.52:0/136755842 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9758107f70 con 0x7f9758106e10 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.023+0000 7f9757fff640 1 --2- 10.20.193.52:0/136755842 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f9758107210 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9744009920 tx=0x7f974402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f182e2efcc0ed4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.023+0000 7f9756ffd640 1 -- 10.20.193.52:0/136755842 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f974403c070 con 0x7f9758106e10 2026-02-24T18:17:36.093 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.024+0000 7f9756ffd640 1 -- 10.20.193.52:0/136755842 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f9744037440 con 0x7f9758106e10 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.024+0000 7f9756ffd640 1 -- 10.20.193.52:0/136755842 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9744035340 con 0x7f9758106e10 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.024+0000 7f975e6c4640 1 -- 10.20.193.52:0/136755842 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 msgr2=0x7f9758107210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.024+0000 7f975e6c4640 1 --2- 10.20.193.52:0/136755842 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f9758107210 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9744009920 tx=0x7f974402ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.024+0000 7f975e6c4640 1 -- 10.20.193.52:0/136755842 shutdown_connections 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.024+0000 7f975e6c4640 1 --2- 10.20.193.52:0/136755842 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f9758107210 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.024+0000 7f975e6c4640 1 -- 10.20.193.52:0/136755842 >> 10.20.193.52:0/136755842 conn(0x7f97581025a0 msgr2=0x7f97581049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.024+0000 7f975e6c4640 1 -- 10.20.193.52:0/136755842 shutdown_connections 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.024+0000 7f975e6c4640 1 -- 10.20.193.52:0/136755842 wait complete. 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.024+0000 7f975e6c4640 1 Processor -- start 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f975e6c4640 1 -- start start 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f975e6c4640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f975819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:36.094 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f975e6c4640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f975810b230 con 0x7f9758106e10 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f9757fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f975819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f9757fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f975819cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56628/0 (socket says 10.20.193.52:56628) 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f9757fff640 1 -- 10.20.193.52:0/164885152 learned_addr learned my addr 10.20.193.52:0/164885152 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f9757fff640 1 -- 10.20.193.52:0/164885152 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975819d470 con 0x7f9758106e10 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f9757fff640 1 --2- 10.20.193.52:0/164885152 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f975819cf30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9744006fd0 tx=0x7f9744037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f97557fa640 1 -- 10.20.193.52:0/164885152 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9744045070 con 0x7f9758106e10 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f975e6c4640 1 -- 10.20.193.52:0/164885152 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975819d700 con 0x7f9758106e10 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f975e6c4640 1 -- 10.20.193.52:0/164885152 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97581a03f0 con 0x7f9758106e10 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f97557fa640 1 -- 10.20.193.52:0/164885152 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f9744040450 con 0x7f9758106e10 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f97557fa640 1 -- 10.20.193.52:0/164885152 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f974403c070 con 0x7f9758106e10 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f97557fa640 1 -- 10.20.193.52:0/164885152 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f974404a440 con 0x7f9758106e10 2026-02-24T18:17:36.095 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f97557fa640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f97557fa640 4 mgrc handle_mgr_map Got map version 1 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f97557fa640 4 mgrc handle_mgr_map Active mgr is now 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f97557fa640 4 mgrc reconnect No active mgr available yet 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.025+0000 7f97557fa640 1 -- 10.20.193.52:0/164885152 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9744049880 con 0x7f9758106e10 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.026+0000 7f975e6c4640 1 -- 10.20.193.52:0/164885152 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9758107290 con 0x7f9758106e10 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.027+0000 7f97557fa640 1 -- 10.20.193.52:0/164885152 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f9744040930 con 0x7f9758106e10 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.055+0000 7f975e6c4640 1 -- 10.20.193.52:0/164885152 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9758196490 con 0x7f9758106e10 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.056+0000 7f97557fa640 1 -- 10.20.193.52:0/164885152 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f9744040600 con 0x7f9758106e10 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.056+0000 7f975e6c4640 10 mgrc shutdown 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.056+0000 7f975e6c4640 1 -- 10.20.193.52:0/164885152 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 msgr2=0x7f975819cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.056+0000 7f975e6c4640 1 --2- 10.20.193.52:0/164885152 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f975819cf30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9744006fd0 tx=0x7f9744037b70 comp rx=0 tx=0).stop 2026-02-24T18:17:36.096 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.056+0000 7f975e6c4640 1 -- 10.20.193.52:0/164885152 shutdown_connections 2026-02-24T18:17:36.097 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.056+0000 7f975e6c4640 1 --2- 10.20.193.52:0/164885152 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9758106e10 0x7f975819cf30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:36.097 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.056+0000 7f975e6c4640 1 -- 10.20.193.52:0/164885152 >> 10.20.193.52:0/164885152 conn(0x7f97581025a0 msgr2=0x7f9758103320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:36.097 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.056+0000 7f975e6c4640 1 -- 10.20.193.52:0/164885152 shutdown_connections 2026-02-24T18:17:36.097 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:36.056+0000 7f975e6c4640 1 -- 10.20.193.52:0/164885152 wait complete. 2026-02-24T18:17:36.097 INFO:teuthology.orchestra.run.trial052.stdout:mgr not available, waiting (1/15)... 2026-02-24T18:17:36.527 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/261405040' entity='client.admin' 2026-02-24T18:17:36.527 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/164885152' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-24T18:17:36.528 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.493+0000 7f15ca6b9140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-24T18:17:36.528 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.524+0000 7f15ca6b9140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-24T18:17:36.828 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.559+0000 7f15ca6b9140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-24T18:17:36.829 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.624+0000 7f15ca6b9140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-24T18:17:36.829 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T18:17:36.829 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T18:17:36.829 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: from numpy import show_config as show_numpy_config 2026-02-24T18:17:36.829 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.697+0000 7f15ca6b9140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-24T18:17:36.829 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.731+0000 7f15ca6b9140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-24T18:17:36.829 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.826+0000 7f15ca6b9140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-24T18:17:37.214 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.885+0000 7f15ca6b9140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-24T18:17:37.215 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.919+0000 7f15ca6b9140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-24T18:17:37.215 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.952+0000 7f15ca6b9140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-24T18:17:37.215 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:36.986+0000 7f15ca6b9140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-24T18:17:37.215 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:37 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:37.016+0000 7f15ca6b9140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-24T18:17:37.515 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:37 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:37.258+0000 7f15ca6b9140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-24T18:17:37.515 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:37 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:37.358+0000 7f15ca6b9140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-24T18:17:37.515 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:37 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:37.388+0000 7f15ca6b9140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-24T18:17:37.515 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:37 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:37.419+0000 7f15ca6b9140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-24T18:17:37.515 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:37 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:37.512+0000 7f15ca6b9140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-24T18:17:37.965 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:37 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:37.541+0000 7f15ca6b9140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-24T18:17:37.965 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:37 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:37.633+0000 7f15ca6b9140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-24T18:17:38.241 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout { 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "fsid": "08cedbc6-11ad-11f1-a33f-d404e6e7d460", 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 0 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout ], 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout ], 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T18:17:38.242 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T18:17:34:352712+0000", 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "restful" 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout ], 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T18:17:34.353211+0000", 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T18:17:38.243 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout } 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.182+0000 7fdb8dfbc640 1 Processor -- start 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.182+0000 7fdb8dfbc640 1 -- start start 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.182+0000 7fdb8dfbc640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881147a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.182+0000 7fdb8dfbc640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88114d70 con 0x7fdb881123b0 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.183+0000 7fdb877fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.183+0000 7fdb877fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881147a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56634/0 (socket says 10.20.193.52:56634) 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.183+0000 7fdb877fe640 1 -- 10.20.193.52:0/2124998642 learned_addr learned my addr 10.20.193.52:0/2124998642 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.183+0000 7fdb877fe640 1 -- 10.20.193.52:0/2124998642 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb88114ef0 con 0x7fdb881123b0 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.183+0000 7fdb877fe640 1 --2- 10.20.193.52:0/2124998642 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881147a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009920 tx=0x7fdb7402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b774f1c6df8981e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.183+0000 7fdb867fc640 1 -- 10.20.193.52:0/2124998642 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7403c070 con 0x7fdb881123b0 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.183+0000 7fdb867fc640 1 -- 10.20.193.52:0/2124998642 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fdb74037440 con 0x7fdb881123b0 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.183+0000 7fdb867fc640 1 -- 10.20.193.52:0/2124998642 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb74035340 con 0x7fdb881123b0 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/2124998642 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 msgr2=0x7fdb881147a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 --2- 10.20.193.52:0/2124998642 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881147a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009920 tx=0x7fdb7402ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/2124998642 shutdown_connections 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 --2- 10.20.193.52:0/2124998642 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881147a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/2124998642 >> 10.20.193.52:0/2124998642 conn(0x7fdb8806e180 msgr2=0x7fdb8806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/2124998642 shutdown_connections 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/2124998642 wait complete. 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 Processor -- start 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 -- start start 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88115e20 con 0x7fdb881123b0 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb877fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb877fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881a7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56638/0 (socket says 10.20.193.52:56638) 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb877fe640 1 -- 10.20.193.52:0/517027140 learned_addr learned my addr 10.20.193.52:0/517027140 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb877fe640 1 -- 10.20.193.52:0/517027140 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb881a8180 con 0x7fdb881123b0 2026-02-24T18:17:38.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb877fe640 1 --2- 10.20.193.52:0/517027140 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881a7c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdb74006fd0 tx=0x7fdb74037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb84ff9640 1 -- 10.20.193.52:0/517027140 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb74045070 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb84ff9640 1 -- 10.20.193.52:0/517027140 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fdb74040450 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/517027140 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb881a8410 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb84ff9640 1 -- 10.20.193.52:0/517027140 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7403c070 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.184+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/517027140 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb881ab100 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.185+0000 7fdb84ff9640 1 -- 10.20.193.52:0/517027140 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdb7404a440 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.185+0000 7fdb84ff9640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.185+0000 7fdb84ff9640 4 mgrc handle_mgr_map Got map version 1 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.185+0000 7fdb84ff9640 4 mgrc handle_mgr_map Active mgr is now 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.185+0000 7fdb84ff9640 4 mgrc reconnect No active mgr available yet 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.185+0000 7fdb84ff9640 1 -- 10.20.193.52:0/517027140 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb74049910 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.185+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/517027140 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb88112810 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.186+0000 7fdb84ff9640 1 -- 10.20.193.52:0/517027140 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fdb74049b10 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.216+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/517027140 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdb8806bfd0 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.216+0000 7fdb84ff9640 1 -- 10.20.193.52:0/517027140 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fdb74049cf0 con 0x7fdb881123b0 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.216+0000 7fdb8dfbc640 10 mgrc shutdown 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.216+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/517027140 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 msgr2=0x7fdb881a7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.216+0000 7fdb8dfbc640 1 --2- 10.20.193.52:0/517027140 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881a7c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdb74006fd0 tx=0x7fdb74037b70 comp rx=0 tx=0).stop 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.216+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/517027140 shutdown_connections 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.216+0000 7fdb8dfbc640 1 --2- 10.20.193.52:0/517027140 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fdb881123b0 0x7fdb881a7c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.216+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/517027140 >> 10.20.193.52:0/517027140 conn(0x7fdb8806e180 msgr2=0x7fdb881102d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.216+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/517027140 shutdown_connections 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:38.216+0000 7fdb8dfbc640 1 -- 10.20.193.52:0/517027140 wait complete. 2026-02-24T18:17:38.245 INFO:teuthology.orchestra.run.trial052.stdout:mgr not available, waiting (2/15)... 2026-02-24T18:17:38.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:38 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/517027140' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-24T18:17:38.465 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:38 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:38.089+0000 7f15ca6b9140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-24T18:17:38.465 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:38 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:38.120+0000 7f15ca6b9140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-24T18:17:38.964 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:38 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:38.520+0000 7f15ca6b9140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-24T18:17:39.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: Activating manager daemon a 2026-02-24T18:17:39.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: mgrmap e2: a(active, starting, since 0.002664s) 2026-02-24T18:17:39.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: from='mgr.14100 10.20.193.52:0/461072519' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-24T18:17:39.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: from='mgr.14100 10.20.193.52:0/461072519' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-24T18:17:39.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: from='mgr.14100 10.20.193.52:0/461072519' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-24T18:17:39.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: from='mgr.14100 10.20.193.52:0/461072519' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-24T18:17:39.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: from='mgr.14100 10.20.193.52:0/461072519' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-24T18:17:39.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: Manager daemon a is now available 2026-02-24T18:17:39.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: from='mgr.14100 10.20.193.52:0/461072519' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-24T18:17:39.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: from='mgr.14100 10.20.193.52:0/461072519' entity='mgr.a' 2026-02-24T18:17:39.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: from='mgr.14100 10.20.193.52:0/461072519' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-24T18:17:39.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: from='mgr.14100 10.20.193.52:0/461072519' entity='mgr.a' 2026-02-24T18:17:39.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:39 trial052 ceph-mon[39446]: from='mgr.14100 10.20.193.52:0/461072519' entity='mgr.a' 2026-02-24T18:17:40.480 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:40.480 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout { 2026-02-24T18:17:40.480 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "fsid": "08cedbc6-11ad-11f1-a33f-d404e6e7d460", 2026-02-24T18:17:40.480 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 0 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout ], 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout ], 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T18:17:34:352712+0000", 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:40.481 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "restful" 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout ], 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T18:17:34.353211+0000", 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout }, 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout } 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.334+0000 7f732e770640 1 Processor -- start 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.334+0000 7f732e770640 1 -- start start 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.334+0000 7f732e770640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f73281094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.334+0000 7f732e770640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7328109aa0 con 0x7f73281090d0 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.334+0000 7f7327fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f73281094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.334+0000 7f7327fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f73281094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56720/0 (socket says 10.20.193.52:56720) 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.334+0000 7f7327fff640 1 -- 10.20.193.52:0/2368953142 learned_addr learned my addr 10.20.193.52:0/2368953142 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.334+0000 7f7327fff640 1 -- 10.20.193.52:0/2368953142 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732810a2c0 con 0x7f73281090d0 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f7327fff640 1 --2- 10.20.193.52:0/2368953142 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f73281094d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7314009920 tx=0x7f731402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8ed671c307c9ee server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f7326ffd640 1 -- 10.20.193.52:0/2368953142 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731403c070 con 0x7f73281090d0 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f7326ffd640 1 -- 10.20.193.52:0/2368953142 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f7314037440 con 0x7f73281090d0 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f7326ffd640 1 -- 10.20.193.52:0/2368953142 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7314035340 con 0x7f73281090d0 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f732e770640 1 -- 10.20.193.52:0/2368953142 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 msgr2=0x7f73281094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f732e770640 1 --2- 10.20.193.52:0/2368953142 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f73281094d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7314009920 tx=0x7f731402ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f732e770640 1 -- 10.20.193.52:0/2368953142 shutdown_connections 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f732e770640 1 --2- 10.20.193.52:0/2368953142 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f73281094d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f732e770640 1 -- 10.20.193.52:0/2368953142 >> 10.20.193.52:0/2368953142 conn(0x7f732807ca50 msgr2=0x7f7328107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f732e770640 1 -- 10.20.193.52:0/2368953142 shutdown_connections 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f732e770640 1 -- 10.20.193.52:0/2368953142 wait complete. 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f732e770640 1 Processor -- start 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.335+0000 7f732e770640 1 -- start start 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f732e770640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f732819f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f732e770640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f732810d4f0 con 0x7f73281090d0 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f7327fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f732819f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f7327fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f732819f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56726/0 (socket says 10.20.193.52:56726) 2026-02-24T18:17:40.482 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f7327fff640 1 -- 10.20.193.52:0/3419254318 learned_addr learned my addr 10.20.193.52:0/3419254318 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f7327fff640 1 -- 10.20.193.52:0/3419254318 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732819f720 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f7327fff640 1 --2- 10.20.193.52:0/3419254318 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f732819f1e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7314006fd0 tx=0x7f7314035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f73257fa640 1 -- 10.20.193.52:0/3419254318 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7314045070 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f73257fa640 1 -- 10.20.193.52:0/3419254318 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f7314040450 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f732e770640 1 -- 10.20.193.52:0/3419254318 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732819f9b0 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f73257fa640 1 -- 10.20.193.52:0/3419254318 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731403c070 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f732e770640 1 -- 10.20.193.52:0/3419254318 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73281a26a0 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f73257fa640 1 -- 10.20.193.52:0/3419254318 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 3) ==== 50130+0+0 (secure 0 0 0) 0x7f73140493b0 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f73257fa640 20 mgrc handle_mgr_map mgrmap(e 3) 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.336+0000 7f732e770640 1 -- 10.20.193.52:0/3419254318 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732810d670 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.337+0000 7f73257fa640 4 mgrc handle_mgr_map Got map version 3 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.337+0000 7f73257fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.337+0000 7f73257fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.337+0000 7f73257fa640 1 --2- 10.20.193.52:0/3419254318 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f72fc03da80 0x7f72fc03ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.337+0000 7f73257fa640 1 -- 10.20.193.52:0/3419254318 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7314076440 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.337+0000 7f73277fe640 1 --2- 10.20.193.52:0/3419254318 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f72fc03da80 0x7f72fc03ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.337+0000 7f73277fe640 1 --2- 10.20.193.52:0/3419254318 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f72fc03da80 0x7f72fc03ff40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f73180099c0 tx=0x7f7318006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.340+0000 7f73257fa640 1 -- 10.20.193.52:0/3419254318 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f731403c210 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.456+0000 7f732e770640 1 -- 10.20.193.52:0/3419254318 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7328198930 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.456+0000 7f73257fa640 1 -- 10.20.193.52:0/3419254318 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f7314033200 con 0x7f73281090d0 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 10 mgrc shutdown 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 1 -- 10.20.193.52:0/3419254318 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f72fc03da80 msgr2=0x7f72fc03ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 1 --2- 10.20.193.52:0/3419254318 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f72fc03da80 0x7f72fc03ff40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f73180099c0 tx=0x7f7318006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 1 -- 10.20.193.52:0/3419254318 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 msgr2=0x7f732819f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 1 --2- 10.20.193.52:0/3419254318 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f732819f1e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7314006fd0 tx=0x7f7314035570 comp rx=0 tx=0).stop 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 1 -- 10.20.193.52:0/3419254318 shutdown_connections 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 1 --2- 10.20.193.52:0/3419254318 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f72fc03da80 0x7f72fc03ff40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 1 --2- 10.20.193.52:0/3419254318 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f73281090d0 0x7f732819f1e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 1 -- 10.20.193.52:0/3419254318 >> 10.20.193.52:0/3419254318 conn(0x7f732807ca50 msgr2=0x7f7328106f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 1 -- 10.20.193.52:0/3419254318 shutdown_connections 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.457+0000 7f732e770640 1 -- 10.20.193.52:0/3419254318 wait complete. 2026-02-24T18:17:40.483 INFO:teuthology.orchestra.run.trial052.stdout:mgr is available 2026-02-24T18:17:40.686 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:40.690 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T18:17:40.690 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout fsid = 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:40.690 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T18:17:40.690 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.52:3300,v1:10.20.193.52:6789] 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.574+0000 7f2718ba0640 1 Processor -- start 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.574+0000 7f2718ba0640 1 -- start start 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.574+0000 7f2718ba0640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f2714109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.574+0000 7f2718ba0640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2714109b50 con 0x7f2714109180 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.574+0000 7f2712575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f2714109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.574+0000 7f2712575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f2714109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56732/0 (socket says 10.20.193.52:56732) 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.574+0000 7f2712575640 1 -- 10.20.193.52:0/881456163 learned_addr learned my addr 10.20.193.52:0/881456163 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.574+0000 7f2712575640 1 -- 10.20.193.52:0/881456163 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271410a2c0 con 0x7f2714109180 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2712575640 1 --2- 10.20.193.52:0/881456163 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f2714109580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2708009920 tx=0x7f270802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763e301d809ac28f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2711573640 1 -- 10.20.193.52:0/881456163 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f270803c070 con 0x7f2714109180 2026-02-24T18:17:40.691 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2711573640 1 -- 10.20.193.52:0/881456163 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f2708037440 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2711573640 1 -- 10.20.193.52:0/881456163 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2708035340 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2718ba0640 1 -- 10.20.193.52:0/881456163 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 msgr2=0x7f2714109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2718ba0640 1 --2- 10.20.193.52:0/881456163 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f2714109580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2708009920 tx=0x7f270802ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2718ba0640 1 -- 10.20.193.52:0/881456163 shutdown_connections 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2718ba0640 1 --2- 10.20.193.52:0/881456163 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f2714109580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2718ba0640 1 -- 10.20.193.52:0/881456163 >> 10.20.193.52:0/881456163 conn(0x7f271407c830 msgr2=0x7f2714107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2718ba0640 1 -- 10.20.193.52:0/881456163 shutdown_connections 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2718ba0640 1 -- 10.20.193.52:0/881456163 wait complete. 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.575+0000 7f2718ba0640 1 Processor -- start 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2718ba0640 1 -- start start 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2718ba0640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f271419f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2718ba0640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f271410d4f0 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2712575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f271419f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2712575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f271419f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56748/0 (socket says 10.20.193.52:56748) 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2712575640 1 -- 10.20.193.52:0/1573577638 learned_addr learned my addr 10.20.193.52:0/1573577638 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2712575640 1 -- 10.20.193.52:0/1573577638 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271419f6f0 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2712575640 1 --2- 10.20.193.52:0/1573577638 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f271419f1b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2708006fd0 tx=0x7f2708037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f26fb7fe640 1 -- 10.20.193.52:0/1573577638 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2708045070 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2718ba0640 1 -- 10.20.193.52:0/1573577638 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271419f980 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f26fb7fe640 1 -- 10.20.193.52:0/1573577638 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f2708040450 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f26fb7fe640 1 -- 10.20.193.52:0/1573577638 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f270803c070 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2718ba0640 1 -- 10.20.193.52:0/1573577638 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27141a2670 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.576+0000 7f2718ba0640 1 -- 10.20.193.52:0/1573577638 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2714109580 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.577+0000 7f26fb7fe640 1 -- 10.20.193.52:0/1573577638 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 4) ==== 50236+0+0 (secure 0 0 0) 0x7f270802fae0 con 0x7f2714109180 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.577+0000 7f26fb7fe640 20 mgrc handle_mgr_map mgrmap(e 4) 2026-02-24T18:17:40.692 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.577+0000 7f26fb7fe640 4 mgrc handle_mgr_map Got map version 4 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.577+0000 7f26fb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.577+0000 7f26fb7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.577+0000 7f26fb7fe640 1 --2- 10.20.193.52:0/1573577638 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f26ec03db50 0x7f26ec040010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.577+0000 7f26fb7fe640 1 -- 10.20.193.52:0/1573577638 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2708076680 con 0x7f2714109180 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.577+0000 7f2711d74640 1 --2- 10.20.193.52:0/1573577638 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f26ec03db50 0x7f26ec040010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.577+0000 7f2711d74640 1 --2- 10.20.193.52:0/1573577638 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f26ec03db50 0x7f26ec040010 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0099c0 tx=0x7f26fc006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.580+0000 7f26fb7fe640 1 -- 10.20.193.52:0/1573577638 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f27080760a0 con 0x7f2714109180 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.665+0000 7f2718ba0640 1 -- 10.20.193.52:0/1573577638 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f27141a39c0 con 0x7f2714109180 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.665+0000 7f26fb7fe640 1 -- 10.20.193.52:0/1573577638 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+465 (secure 0 0 0) 0x7f270803ad80 con 0x7f2714109180 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 10 mgrc shutdown 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 1 -- 10.20.193.52:0/1573577638 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f26ec03db50 msgr2=0x7f26ec040010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 1 --2- 10.20.193.52:0/1573577638 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f26ec03db50 0x7f26ec040010 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0099c0 tx=0x7f26fc006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 1 -- 10.20.193.52:0/1573577638 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 msgr2=0x7f271419f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 1 --2- 10.20.193.52:0/1573577638 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f271419f1b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2708006fd0 tx=0x7f2708037b70 comp rx=0 tx=0).stop 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 1 -- 10.20.193.52:0/1573577638 shutdown_connections 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 1 --2- 10.20.193.52:0/1573577638 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f26ec03db50 0x7f26ec040010 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 1 --2- 10.20.193.52:0/1573577638 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f2714109180 0x7f271419f1b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 1 -- 10.20.193.52:0/1573577638 >> 10.20.193.52:0/1573577638 conn(0x7f271407c830 msgr2=0x7f2714106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 1 -- 10.20.193.52:0/1573577638 shutdown_connections 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.666+0000 7f2718ba0640 1 -- 10.20.193.52:0/1573577638 wait complete. 2026-02-24T18:17:40.693 INFO:teuthology.orchestra.run.trial052.stdout:Enabling cephadm module... 2026-02-24T18:17:40.801 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:40 trial052 ceph-mon[39446]: mgrmap e3: a(active, since 1.00494s) 2026-02-24T18:17:40.801 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:40 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/3419254318' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-24T18:17:41.560 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.863+0000 7f620a89b640 1 Processor -- start 2026-02-24T18:17:41.561 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.863+0000 7f620a89b640 1 -- start start 2026-02-24T18:17:41.561 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.863+0000 7f620a89b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f62041094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:41.561 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.863+0000 7f620a89b640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6204109aa0 con 0x7f62041090d0 2026-02-24T18:17:41.561 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.863+0000 7f6203fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f62041094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:41.562 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.863+0000 7f6203fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f62041094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56750/0 (socket says 10.20.193.52:56750) 2026-02-24T18:17:41.562 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.863+0000 7f6203fff640 1 -- 10.20.193.52:0/2285586688 learned_addr learned my addr 10.20.193.52:0/2285586688 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:41.562 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f6203fff640 1 -- 10.20.193.52:0/2285586688 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620410a2d0 con 0x7f62041090d0 2026-02-24T18:17:41.562 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f6203fff640 1 --2- 10.20.193.52:0/2285586688 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f62041094d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009920 tx=0x7f61f002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff4e5462e1fd9e9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:41.562 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f6202ffd640 1 -- 10.20.193.52:0/2285586688 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f003c070 con 0x7f62041090d0 2026-02-24T18:17:41.562 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f6202ffd640 1 -- 10.20.193.52:0/2285586688 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f61f0037440 con 0x7f62041090d0 2026-02-24T18:17:41.562 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f6202ffd640 1 -- 10.20.193.52:0/2285586688 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f0035340 con 0x7f62041090d0 2026-02-24T18:17:41.562 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f620a89b640 1 -- 10.20.193.52:0/2285586688 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 msgr2=0x7f62041094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:41.562 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f620a89b640 1 --2- 10.20.193.52:0/2285586688 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f62041094d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009920 tx=0x7f61f002ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:41.562 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f620a89b640 1 -- 10.20.193.52:0/2285586688 shutdown_connections 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f620a89b640 1 --2- 10.20.193.52:0/2285586688 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f62041094d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f620a89b640 1 -- 10.20.193.52:0/2285586688 >> 10.20.193.52:0/2285586688 conn(0x7f620407ca50 msgr2=0x7f6204107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f620a89b640 1 -- 10.20.193.52:0/2285586688 shutdown_connections 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.864+0000 7f620a89b640 1 -- 10.20.193.52:0/2285586688 wait complete. 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f620a89b640 1 Processor -- start 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f620a89b640 1 -- start start 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f620a89b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f620419f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f620a89b640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f620410d500 con 0x7f62041090d0 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f6203fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f620419f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f6203fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f620419f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56762/0 (socket says 10.20.193.52:56762) 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f6203fff640 1 -- 10.20.193.52:0/2603704467 learned_addr learned my addr 10.20.193.52:0/2603704467 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:41.563 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f6203fff640 1 -- 10.20.193.52:0/2603704467 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620419f6e0 con 0x7f62041090d0 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f6203fff640 1 --2- 10.20.193.52:0/2603704467 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f620419f1a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f61f0006fd0 tx=0x7f61f0037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f62017fa640 1 -- 10.20.193.52:0/2603704467 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f0045070 con 0x7f62041090d0 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f62017fa640 1 -- 10.20.193.52:0/2603704467 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f61f0040450 con 0x7f62041090d0 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f620a89b640 1 -- 10.20.193.52:0/2603704467 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620419f970 con 0x7f62041090d0 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f62017fa640 1 -- 10.20.193.52:0/2603704467 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f003c070 con 0x7f62041090d0 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.865+0000 7f620a89b640 1 -- 10.20.193.52:0/2603704467 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62041a2660 con 0x7f62041090d0 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.866+0000 7f620a89b640 1 -- 10.20.193.52:0/2603704467 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620410d680 con 0x7f62041090d0 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.866+0000 7f62017fa640 1 -- 10.20.193.52:0/2603704467 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 4) ==== 50236+0+0 (secure 0 0 0) 0x7f61f00493b0 con 0x7f62041090d0 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.866+0000 7f62017fa640 20 mgrc handle_mgr_map mgrmap(e 4) 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.866+0000 7f62017fa640 4 mgrc handle_mgr_map Got map version 4 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.866+0000 7f62017fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:41.564 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.866+0000 7f62017fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:41.565 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.866+0000 7f62017fa640 1 --2- 10.20.193.52:0/2603704467 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f61d803dba0 0x7f61d8040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:41.565 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.866+0000 7f62017fa640 1 -- 10.20.193.52:0/2603704467 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f61f0076670 con 0x7f62041090d0 2026-02-24T18:17:41.565 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.866+0000 7f62037fe640 1 --2- 10.20.193.52:0/2603704467 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f61d803dba0 0x7f61d8040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:41.565 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.866+0000 7f62037fe640 1 --2- 10.20.193.52:0/2603704467 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f61d803dba0 0x7f61d8040060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61f40099c0 tx=0x7f61f4006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:41.565 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.869+0000 7f62017fa640 1 -- 10.20.193.52:0/2603704467 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f61f003c210 con 0x7f62041090d0 2026-02-24T18:17:41.565 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:40.972+0000 7f620a89b640 1 -- 10.20.193.52:0/2603704467 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f6204198940 con 0x7f62041090d0 2026-02-24T18:17:41.565 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.530+0000 7f62017fa640 1 -- 10.20.193.52:0/2603704467 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f61f0076090 con 0x7f62041090d0 2026-02-24T18:17:41.565 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.531+0000 7f62017fa640 1 -- 10.20.193.52:0/2603704467 <== mon.0 v2:10.20.193.52:3300/0 8 ==== mgrmap(e 5) ==== 50247+0+0 (secure 0 0 0) 0x7f61f0033200 con 0x7f62041090d0 2026-02-24T18:17:41.565 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.531+0000 7f62017fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.532+0000 7f62017fa640 4 mgrc handle_mgr_map Got map version 5 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.532+0000 7f62017fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.532+0000 7f620a89b640 10 mgrc shutdown 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.532+0000 7f620a89b640 1 -- 10.20.193.52:0/2603704467 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f61d803dba0 msgr2=0x7f61d8040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.532+0000 7f620a89b640 1 --2- 10.20.193.52:0/2603704467 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f61d803dba0 0x7f61d8040060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61f40099c0 tx=0x7f61f4006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.532+0000 7f620a89b640 1 -- 10.20.193.52:0/2603704467 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 msgr2=0x7f620419f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.532+0000 7f620a89b640 1 --2- 10.20.193.52:0/2603704467 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f620419f1a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f61f0006fd0 tx=0x7f61f0037b70 comp rx=0 tx=0).stop 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.533+0000 7f620a89b640 1 -- 10.20.193.52:0/2603704467 shutdown_connections 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.533+0000 7f620a89b640 1 --2- 10.20.193.52:0/2603704467 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f61d803dba0 0x7f61d8040060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.533+0000 7f620a89b640 1 --2- 10.20.193.52:0/2603704467 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f62041090d0 0x7f620419f1a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:41.566 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.533+0000 7f620a89b640 1 -- 10.20.193.52:0/2603704467 >> 10.20.193.52:0/2603704467 conn(0x7f620407ca50 msgr2=0x7f6204106e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:41.567 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.533+0000 7f620a89b640 1 -- 10.20.193.52:0/2603704467 shutdown_connections 2026-02-24T18:17:41.567 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.533+0000 7f620a89b640 1 -- 10.20.193.52:0/2603704467 wait complete. 2026-02-24T18:17:41.784 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:41 trial052 ceph-mon[39446]: mgrmap e4: a(active, since 2s) 2026-02-24T18:17:41.784 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:41 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1573577638' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-24T18:17:41.784 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:41 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2603704467' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-24T18:17:41.784 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:41 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: ignoring --setuser ceph since I am not root 2026-02-24T18:17:41.784 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:41 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: ignoring --setgroup ceph since I am not root 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout { 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout } 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.655+0000 7fc5e6894640 1 Processor -- start 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.655+0000 7fc5e6894640 1 -- start start 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.655+0000 7fc5e6894640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e01094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.655+0000 7fc5e6894640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e0109aa0 con 0x7fc5e01090d0 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.655+0000 7fc5dffff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e01094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:41.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.655+0000 7fc5dffff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e01094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56776/0 (socket says 10.20.193.52:56776) 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.655+0000 7fc5dffff640 1 -- 10.20.193.52:0/3444946887 learned_addr learned my addr 10.20.193.52:0/3444946887 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5dffff640 1 -- 10.20.193.52:0/3444946887 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e010a2d0 con 0x7fc5e01090d0 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5dffff640 1 --2- 10.20.193.52:0/3444946887 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e01094d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009920 tx=0x7fc5cc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fde18f9bd151d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5deffd640 1 -- 10.20.193.52:0/3444946887 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5cc03c070 con 0x7fc5e01090d0 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5deffd640 1 -- 10.20.193.52:0/3444946887 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fc5cc037440 con 0x7fc5e01090d0 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5deffd640 1 -- 10.20.193.52:0/3444946887 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5cc035340 con 0x7fc5e01090d0 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5e6894640 1 -- 10.20.193.52:0/3444946887 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 msgr2=0x7fc5e01094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5e6894640 1 --2- 10.20.193.52:0/3444946887 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e01094d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009920 tx=0x7fc5cc02ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5e6894640 1 -- 10.20.193.52:0/3444946887 shutdown_connections 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5e6894640 1 --2- 10.20.193.52:0/3444946887 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e01094d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5e6894640 1 -- 10.20.193.52:0/3444946887 >> 10.20.193.52:0/3444946887 conn(0x7fc5e007ca50 msgr2=0x7fc5e0107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5e6894640 1 -- 10.20.193.52:0/3444946887 shutdown_connections 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.656+0000 7fc5e6894640 1 -- 10.20.193.52:0/3444946887 wait complete. 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5e6894640 1 Processor -- start 2026-02-24T18:17:41.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5e6894640 1 -- start start 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5e6894640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e019f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5e6894640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e010d500 con 0x7fc5e01090d0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5dffff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e019f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5dffff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e019f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56792/0 (socket says 10.20.193.52:56792) 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5dffff640 1 -- 10.20.193.52:0/2592387442 learned_addr learned my addr 10.20.193.52:0/2592387442 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5dffff640 1 -- 10.20.193.52:0/2592387442 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e019f6a0 con 0x7fc5e01090d0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5dffff640 1 --2- 10.20.193.52:0/2592387442 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e019f160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc006fd0 tx=0x7fc5cc035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5dd7fa640 1 -- 10.20.193.52:0/2592387442 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5cc045070 con 0x7fc5e01090d0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5dd7fa640 1 -- 10.20.193.52:0/2592387442 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fc5cc040450 con 0x7fc5e01090d0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5e6894640 1 -- 10.20.193.52:0/2592387442 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e019f930 con 0x7fc5e01090d0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5dd7fa640 1 -- 10.20.193.52:0/2592387442 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5cc03c070 con 0x7fc5e01090d0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.657+0000 7fc5e6894640 1 -- 10.20.193.52:0/2592387442 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e01a2620 con 0x7fc5e01090d0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.658+0000 7fc5e6894640 1 -- 10.20.193.52:0/2592387442 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e010d680 con 0x7fc5e01090d0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.658+0000 7fc5dd7fa640 1 -- 10.20.193.52:0/2592387442 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 5) ==== 50247+0+0 (secure 0 0 0) 0x7fc5cc02fae0 con 0x7fc5e01090d0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.658+0000 7fc5dd7fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.658+0000 7fc5dd7fa640 4 mgrc handle_mgr_map Got map version 5 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.658+0000 7fc5dd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.658+0000 7fc5dd7fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.658+0000 7fc5dd7fa640 1 --2- 10.20.193.52:0/2592387442 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7fc5b403dba0 0x7fc5b4040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.658+0000 7fc5df7fe640 1 -- 10.20.193.52:0/2592387442 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7fc5b403dba0 msgr2=0x7fc5b4040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.52:6800/4278953045 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.658+0000 7fc5dd7fa640 1 -- 10.20.193.52:0/2592387442 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc5cc076770 con 0x7fc5e01090d0 2026-02-24T18:17:41.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.658+0000 7fc5df7fe640 1 --2- 10.20.193.52:0/2592387442 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7fc5b403dba0 0x7fc5b4040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.661+0000 7fc5dd7fa640 1 -- 10.20.193.52:0/2592387442 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc5cc076190 con 0x7fc5e01090d0 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.766+0000 7fc5e6894640 1 -- 10.20.193.52:0/2592387442 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fc5e0109550 con 0x7fc5e01090d0 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.766+0000 7fc5dd7fa640 1 -- 10.20.193.52:0/2592387442 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fc5cc0408e0 con 0x7fc5e01090d0 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 10 mgrc shutdown 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 1 -- 10.20.193.52:0/2592387442 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7fc5b403dba0 msgr2=0x7fc5b4040060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 1 --2- 10.20.193.52:0/2592387442 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7fc5b403dba0 0x7fc5b4040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 1 -- 10.20.193.52:0/2592387442 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 msgr2=0x7fc5e019f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 1 --2- 10.20.193.52:0/2592387442 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e019f160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc006fd0 tx=0x7fc5cc035f80 comp rx=0 tx=0).stop 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 1 -- 10.20.193.52:0/2592387442 shutdown_connections 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 1 --2- 10.20.193.52:0/2592387442 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7fc5b403dba0 0x7fc5b4040060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 1 --2- 10.20.193.52:0/2592387442 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc5e01090d0 0x7fc5e019f160 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 1 -- 10.20.193.52:0/2592387442 >> 10.20.193.52:0/2592387442 conn(0x7fc5e007ca50 msgr2=0x7fc5e0106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 1 -- 10.20.193.52:0/2592387442 shutdown_connections 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.768+0000 7fc5e6894640 1 -- 10.20.193.52:0/2592387442 wait complete. 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:Waiting for the mgr to restart... 2026-02-24T18:17:41.794 INFO:teuthology.orchestra.run.trial052.stdout:Waiting for mgr epoch 5... 2026-02-24T18:17:42.091 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:41 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:41.945+0000 7fac2d2fd140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-24T18:17:42.092 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.089+0000 7fac2d2fd140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-24T18:17:42.366 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.123+0000 7fac2d2fd140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-24T18:17:42.366 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.164+0000 7fac2d2fd140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-24T18:17:42.366 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.195+0000 7fac2d2fd140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-24T18:17:42.367 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.229+0000 7fac2d2fd140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-24T18:17:42.367 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.295+0000 7fac2d2fd140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-24T18:17:42.367 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T18:17:42.367 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T18:17:42.367 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: from numpy import show_config as show_numpy_config 2026-02-24T18:17:42.625 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2603704467' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-24T18:17:42.625 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-mon[39446]: mgrmap e5: a(active, since 3s) 2026-02-24T18:17:42.625 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2592387442' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-24T18:17:42.625 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.367+0000 7fac2d2fd140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-24T18:17:42.625 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.401+0000 7fac2d2fd140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-24T18:17:42.626 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.496+0000 7fac2d2fd140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-24T18:17:42.626 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.555+0000 7fac2d2fd140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-24T18:17:42.626 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.589+0000 7fac2d2fd140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-24T18:17:42.626 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.622+0000 7fac2d2fd140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-24T18:17:42.922 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.656+0000 7fac2d2fd140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-24T18:17:42.922 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.687+0000 7fac2d2fd140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-24T18:17:42.922 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:42.919+0000 7fac2d2fd140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-24T18:17:43.176 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:43 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:43.020+0000 7fac2d2fd140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-24T18:17:43.176 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:43 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:43.049+0000 7fac2d2fd140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-24T18:17:43.176 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:43 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:43.081+0000 7fac2d2fd140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-24T18:17:43.176 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:43 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:43.174+0000 7fac2d2fd140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-24T18:17:43.465 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:43 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:43.203+0000 7fac2d2fd140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-24T18:17:43.465 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:43 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:43.296+0000 7fac2d2fd140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-24T18:17:44.181 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:43 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:43.754+0000 7fac2d2fd140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-24T18:17:44.181 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:43 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:43.784+0000 7fac2d2fd140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-24T18:17:44.465 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:44.180+0000 7fac2d2fd140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-24T18:17:44.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: Active manager daemon a restarted 2026-02-24T18:17:44.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: Activating manager daemon a 2026-02-24T18:17:44.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: osdmap e2: 0 total, 0 up, 0 in 2026-02-24T18:17:44.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: mgrmap e6: a(active, starting, since 0.00283227s) 2026-02-24T18:17:44.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-24T18:17:44.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-24T18:17:44.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-24T18:17:44.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-24T18:17:44.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-24T18:17:44.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: Manager daemon a is now available 2026-02-24T18:17:44.466 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:44.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:44.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:17:44.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:17:44.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-24T18:17:44.467 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:44 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-24T18:17:45.217 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout { 2026-02-24T18:17:45.217 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-24T18:17:45.218 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T18:17:45.218 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout } 2026-02-24T18:17:45.218 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.890+0000 7f39956fb640 1 Processor -- start 2026-02-24T18:17:45.218 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.890+0000 7f39956fb640 1 -- start start 2026-02-24T18:17:45.218 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.890+0000 7f39956fb640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f39901094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.218 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.890+0000 7f39956fb640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3990109aa0 con 0x7f39901090d0 2026-02-24T18:17:45.218 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.890+0000 7f398effd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f39901094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.218 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.890+0000 7f398effd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f39901094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56798/0 (socket says 10.20.193.52:56798) 2026-02-24T18:17:45.218 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.890+0000 7f398effd640 1 -- 10.20.193.52:0/3356882091 learned_addr learned my addr 10.20.193.52:0/3356882091 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:45.218 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f398effd640 1 -- 10.20.193.52:0/3356882091 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399010a2f0 con 0x7f39901090d0 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f398effd640 1 --2- 10.20.193.52:0/3356882091 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f39901094d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3984009920 tx=0x7f398402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809f46e92f5609d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f398dffb640 1 -- 10.20.193.52:0/3356882091 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f398403c070 con 0x7f39901090d0 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f398dffb640 1 -- 10.20.193.52:0/3356882091 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f3984037440 con 0x7f39901090d0 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f398dffb640 1 -- 10.20.193.52:0/3356882091 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3984035340 con 0x7f39901090d0 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f39956fb640 1 -- 10.20.193.52:0/3356882091 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 msgr2=0x7f39901094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f39956fb640 1 --2- 10.20.193.52:0/3356882091 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f39901094d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3984009920 tx=0x7f398402ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f39956fb640 1 -- 10.20.193.52:0/3356882091 shutdown_connections 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f39956fb640 1 --2- 10.20.193.52:0/3356882091 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f39901094d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f39956fb640 1 -- 10.20.193.52:0/3356882091 >> 10.20.193.52:0/3356882091 conn(0x7f399007c830 msgr2=0x7f3990107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f39956fb640 1 -- 10.20.193.52:0/3356882091 shutdown_connections 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.891+0000 7f39956fb640 1 -- 10.20.193.52:0/3356882091 wait complete. 2026-02-24T18:17:45.219 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f39956fb640 1 Processor -- start 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f39956fb640 1 -- start start 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f39956fb640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f399019f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f39956fb640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f399010d520 con 0x7f39901090d0 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f398effd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f399019f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f398effd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f399019f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:56806/0 (socket says 10.20.193.52:56806) 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f398effd640 1 -- 10.20.193.52:0/1447352201 learned_addr learned my addr 10.20.193.52:0/1447352201 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f398effd640 1 -- 10.20.193.52:0/1447352201 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399019f770 con 0x7f39901090d0 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f398effd640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f399019f230 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3984006fd0 tx=0x7f3984035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3984045070 con 0x7f39901090d0 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f3984040450 con 0x7f39901090d0 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f39956fb640 1 -- 10.20.193.52:0/1447352201 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399019fa00 con 0x7f39901090d0 2026-02-24T18:17:45.220 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f398403c070 con 0x7f39901090d0 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.892+0000 7f39956fb640 1 -- 10.20.193.52:0/1447352201 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39901a26f0 con 0x7f39901090d0 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f39956fb640 20 mgrc start_tell_command target: cmd: [{"prefix": "get_command_descriptions"}] 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f39956fb640 5 mgrc start_tell_command no mgr session (no running mgr daemon?), or not active mgr, waiting 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 5) ==== 50247+0+0 (secure 0 0 0) 0x7f398402fae0 con 0x7f39901090d0 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f396ffff640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f396ffff640 4 mgrc handle_mgr_map Got map version 5 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f396ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f396ffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f396ffff640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 0x7f3964040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f396ffff640 10 mgrc reconnect resending 0 (tell) 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 --> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3964040770 con 0x7f396403dba0 2026-02-24T18:17:45.221 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f398e7fc640 1 -- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 msgr2=0x7f3964040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.52:6800/4278953045 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39840766e0 con 0x7f39901090d0 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:41.893+0000 7f398e7fc640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 0x7f3964040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:42.094+0000 7f398e7fc640 1 -- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 msgr2=0x7f3964040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.52:6800/4278953045 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:42.094+0000 7f398e7fc640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 0x7f3964040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:42.495+0000 7f398e7fc640 1 -- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 msgr2=0x7f3964040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.52:6800/4278953045 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:42.495+0000 7f398e7fc640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 0x7f3964040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:43.296+0000 7f398e7fc640 1 -- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 msgr2=0x7f3964040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.52:6800/4278953045 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:43.297+0000 7f398e7fc640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 0x7f3964040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:44.183+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mgrmap(e 6) ==== 50014+0+0 (secure 0 0 0) 0x7f39840751a0 con 0x7f39901090d0 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:44.183+0000 7f396ffff640 20 mgrc handle_mgr_map mgrmap(e 6) 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:44.183+0000 7f396ffff640 4 mgrc handle_mgr_map Got map version 6 2026-02-24T18:17:45.222 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:44.183+0000 7f396ffff640 4 mgrc handle_mgr_map Active mgr is now 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:44.183+0000 7f396ffff640 4 mgrc reconnect Terminating session with v2:10.20.193.52:6800/4278953045 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:44.183+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 msgr2=0x7f3964040060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:44.183+0000 7f396ffff640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 0x7f3964040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:44.183+0000 7f396ffff640 4 mgrc reconnect No active mgr available yet 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.183+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7f39840758a0 con 0x7f39901090d0 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.183+0000 7f396ffff640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.183+0000 7f396ffff640 4 mgrc handle_mgr_map Got map version 7 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.183+0000 7f396ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.183+0000 7f396ffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.183+0000 7f396ffff640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f39640414f0 0x7f39640438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.183+0000 7f396ffff640 10 mgrc reconnect resending 0 (tell) 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.183+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 --> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3984044ec0 con 0x7f39640414f0 2026-02-24T18:17:45.223 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.184+0000 7f398e7fc640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f39640414f0 0x7f39640438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.184+0000 7f398e7fc640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f39640414f0 0x7f39640438e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3978003a80 tx=0x7f3978009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.184+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 <== mgr.14118 v2:10.20.193.52:6800/3088300703 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f3984044ec0 con 0x7f39640414f0 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.184+0000 7f396ffff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 20 mgrc start_tell_command target: cmd: [{"prefix": "mgr_status"}] 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 -- 10.20.193.52:0/1447352201 --> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f399019fee0 con 0x7f39640414f0 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f396ffff640 1 -- 10.20.193.52:0/1447352201 <== mgr.14118 v2:10.20.193.52:6800/3088300703 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f399019fee0 con 0x7f39640414f0 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f396ffff640 20 mgrc handle_command_reply tid 1 r 0 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 10 mgrc shutdown 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 -- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f39640414f0 msgr2=0x7f39640438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f39640414f0 0x7f39640438e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3978003a80 tx=0x7f3978009290 comp rx=0 tx=0).stop 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 -- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 msgr2=0x7f399019f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.224 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f399019f230 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3984006fd0 tx=0x7f3984035f80 comp rx=0 tx=0).stop 2026-02-24T18:17:45.225 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 -- 10.20.193.52:0/1447352201 shutdown_connections 2026-02-24T18:17:45.225 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f39640414f0 0x7f39640438e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.225 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:6800/4278953045,v1:10.20.193.52:6801/4278953045] conn(0x7f396403dba0 0x7f3964040060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.225 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 --2- 10.20.193.52:0/1447352201 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f39901090d0 0x7f399019f230 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.225 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 -- 10.20.193.52:0/1447352201 >> 10.20.193.52:0/1447352201 conn(0x7f399007c830 msgr2=0x7f3990106eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:45.225 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 -- 10.20.193.52:0/1447352201 shutdown_connections 2026-02-24T18:17:45.225 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.188+0000 7f39956fb640 1 -- 10.20.193.52:0/1447352201 wait complete. 2026-02-24T18:17:45.225 INFO:teuthology.orchestra.run.trial052.stdout:mgr epoch 5 is available 2026-02-24T18:17:45.225 INFO:teuthology.orchestra.run.trial052.stdout:Setting orchestrator backend to cephadm... 2026-02-24T18:17:45.436 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.310+0000 7fcb7bfe7640 1 Processor -- start 2026-02-24T18:17:45.436 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.310+0000 7fcb7bfe7640 1 -- start start 2026-02-24T18:17:45.436 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.310+0000 7fcb7bfe7640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7407b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.310+0000 7fcb7bfe7640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7407b7f0 con 0x7fcb7407ce50 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.310+0000 7fcb79d5c640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7407b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.310+0000 7fcb79d5c640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7407b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58486/0 (socket says 10.20.193.52:58486) 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.310+0000 7fcb79d5c640 1 -- 10.20.193.52:0/577885587 learned_addr learned my addr 10.20.193.52:0/577885587 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.311+0000 7fcb79d5c640 1 -- 10.20.193.52:0/577885587 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7407b970 con 0x7fcb7407ce50 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.311+0000 7fcb79d5c640 1 --2- 10.20.193.52:0/577885587 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7407b2b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009920 tx=0x7fcb6402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5327eabb794a50 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.311+0000 7fcb78d5a640 1 -- 10.20.193.52:0/577885587 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6403c070 con 0x7fcb7407ce50 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.311+0000 7fcb78d5a640 1 -- 10.20.193.52:0/577885587 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fcb64037440 con 0x7fcb7407ce50 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.311+0000 7fcb78d5a640 1 -- 10.20.193.52:0/577885587 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb64035340 con 0x7fcb7407ce50 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.311+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/577885587 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 msgr2=0x7fcb7407b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.437 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.311+0000 7fcb7bfe7640 1 --2- 10.20.193.52:0/577885587 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7407b2b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009920 tx=0x7fcb6402ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.311+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/577885587 shutdown_connections 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.311+0000 7fcb7bfe7640 1 --2- 10.20.193.52:0/577885587 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7407b2b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/577885587 >> 10.20.193.52:0/577885587 conn(0x7fcb741025c0 msgr2=0x7fcb74104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/577885587 shutdown_connections 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/577885587 wait complete. 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb7bfe7640 1 Processor -- start 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb7bfe7640 1 -- start start 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb7bfe7640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7419f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb7bfe7640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7410d2a0 con 0x7fcb7407ce50 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb79d5c640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7419f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.438 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb79d5c640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7419f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58496/0 (socket says 10.20.193.52:58496) 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb79d5c640 1 -- 10.20.193.52:0/3534307685 learned_addr learned my addr 10.20.193.52:0/3534307685 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb79d5c640 1 -- 10.20.193.52:0/3534307685 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7419f690 con 0x7fcb7407ce50 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb79d5c640 1 --2- 10.20.193.52:0/3534307685 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7419f150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcb64006fd0 tx=0x7fcb64035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb62ffd640 1 -- 10.20.193.52:0/3534307685 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb64045070 con 0x7fcb7407ce50 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb62ffd640 1 -- 10.20.193.52:0/3534307685 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fcb64040450 con 0x7fcb7407ce50 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb62ffd640 1 -- 10.20.193.52:0/3534307685 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6403c070 con 0x7fcb7407ce50 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/3534307685 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7419f920 con 0x7fcb7407ce50 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.312+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/3534307685 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb741a2610 con 0x7fcb7407ce50 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.313+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/3534307685 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7407b330 con 0x7fcb7407ce50 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.313+0000 7fcb62ffd640 1 -- 10.20.193.52:0/3534307685 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7fcb6402fae0 con 0x7fcb7407ce50 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.313+0000 7fcb62ffd640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-24T18:17:45.439 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.313+0000 7fcb62ffd640 4 mgrc handle_mgr_map Got map version 7 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.313+0000 7fcb62ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.313+0000 7fcb62ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.313+0000 7fcb62ffd640 1 --2- 10.20.193.52:0/3534307685 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcb5003da80 0x7fcb5003ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.313+0000 7fcb62ffd640 1 -- 10.20.193.52:0/3534307685 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcb640765f0 con 0x7fcb7407ce50 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.313+0000 7fcb7955b640 1 --2- 10.20.193.52:0/3534307685 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcb5003da80 0x7fcb5003ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.314+0000 7fcb7955b640 1 --2- 10.20.193.52:0/3534307685 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcb5003da80 0x7fcb5003ff40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcb680099c0 tx=0x7fcb68006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.316+0000 7fcb62ffd640 1 -- 10.20.193.52:0/3534307685 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcb640408e0 con 0x7fcb7407ce50 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.406+0000 7fcb7bfe7640 20 mgrc start_command cmd: [{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}] 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.406+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/3534307685 --> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fcb74197640 con 0x7fcb5003da80 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.409+0000 7fcb62ffd640 1 -- 10.20.193.52:0/3534307685 <== mgr.14118 v2:10.20.193.52:6800/3088300703 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcb74197640 con 0x7fcb5003da80 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.409+0000 7fcb62ffd640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:45.440 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 10 mgrc shutdown 2026-02-24T18:17:45.441 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/3534307685 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcb5003da80 msgr2=0x7fcb5003ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.441 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 1 --2- 10.20.193.52:0/3534307685 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcb5003da80 0x7fcb5003ff40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcb680099c0 tx=0x7fcb68006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.441 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/3534307685 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 msgr2=0x7fcb7419f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.441 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 1 --2- 10.20.193.52:0/3534307685 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7419f150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcb64006fd0 tx=0x7fcb64035f80 comp rx=0 tx=0).stop 2026-02-24T18:17:45.441 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/3534307685 shutdown_connections 2026-02-24T18:17:45.441 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 1 --2- 10.20.193.52:0/3534307685 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcb5003da80 0x7fcb5003ff40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.441 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 1 --2- 10.20.193.52:0/3534307685 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcb7407ce50 0x7fcb7419f150 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.441 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/3534307685 >> 10.20.193.52:0/3534307685 conn(0x7fcb741025c0 msgr2=0x7fcb74103270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:45.441 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/3534307685 shutdown_connections 2026-02-24T18:17:45.441 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.410+0000 7fcb7bfe7640 1 -- 10.20.193.52:0/3534307685 wait complete. 2026-02-24T18:17:45.453 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-mon[39446]: Found migration_current of "None". Setting to last migration. 2026-02-24T18:17:45.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:45.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:45.454 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-mon[39446]: mgrmap e7: a(active, since 1.00388s) 2026-02-24T18:17:45.637 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-24T18:17:45.638 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.523+0000 7fb85d1c6640 1 Processor -- start 2026-02-24T18:17:45.638 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.523+0000 7fb85d1c6640 1 -- start start 2026-02-24T18:17:45.638 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.523+0000 7fb85d1c6640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb858105470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.638 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.523+0000 7fb85d1c6640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8581059b0 con 0x7fb858105070 2026-02-24T18:17:45.638 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.523+0000 7fb856d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb858105470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.638 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.523+0000 7fb856d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb858105470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58502/0 (socket says 10.20.193.52:58502) 2026-02-24T18:17:45.638 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.523+0000 7fb856d76640 1 -- 10.20.193.52:0/2180187375 learned_addr learned my addr 10.20.193.52:0/2180187375 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:45.638 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.523+0000 7fb856d76640 1 -- 10.20.193.52:0/2180187375 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb858105b30 con 0x7fb858105070 2026-02-24T18:17:45.638 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb856d76640 1 --2- 10.20.193.52:0/2180187375 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb858105470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009920 tx=0x7fb84c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a935ee37027fbba8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.638 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb855d74640 1 -- 10.20.193.52:0/2180187375 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c03c070 con 0x7fb858105070 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb855d74640 1 -- 10.20.193.52:0/2180187375 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fb84c037440 con 0x7fb858105070 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb855d74640 1 -- 10.20.193.52:0/2180187375 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c035340 con 0x7fb858105070 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb85d1c6640 1 -- 10.20.193.52:0/2180187375 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 msgr2=0x7fb858105470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb85d1c6640 1 --2- 10.20.193.52:0/2180187375 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb858105470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009920 tx=0x7fb84c02ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb85d1c6640 1 -- 10.20.193.52:0/2180187375 shutdown_connections 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb85d1c6640 1 --2- 10.20.193.52:0/2180187375 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb858105470 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb85d1c6640 1 -- 10.20.193.52:0/2180187375 >> 10.20.193.52:0/2180187375 conn(0x7fb858100be0 msgr2=0x7fb858103020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb85d1c6640 1 -- 10.20.193.52:0/2180187375 shutdown_connections 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.524+0000 7fb85d1c6640 1 -- 10.20.193.52:0/2180187375 wait complete. 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb85d1c6640 1 Processor -- start 2026-02-24T18:17:45.639 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb85d1c6640 1 -- start start 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb85d1c6640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb85819f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb85d1c6640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb858106a90 con 0x7fb858105070 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb856d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb85819f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb856d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb85819f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58514/0 (socket says 10.20.193.52:58514) 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb856d76640 1 -- 10.20.193.52:0/1284923007 learned_addr learned my addr 10.20.193.52:0/1284923007 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb856d76640 1 -- 10.20.193.52:0/1284923007 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85819f730 con 0x7fb858105070 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb856d76640 1 --2- 10.20.193.52:0/1284923007 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb85819f1f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb84c006fd0 tx=0x7fb84c035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb837fff640 1 -- 10.20.193.52:0/1284923007 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c045070 con 0x7fb858105070 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb837fff640 1 -- 10.20.193.52:0/1284923007 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fb84c040450 con 0x7fb858105070 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb85d1c6640 1 -- 10.20.193.52:0/1284923007 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85819f9c0 con 0x7fb858105070 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb837fff640 1 -- 10.20.193.52:0/1284923007 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c03c070 con 0x7fb858105070 2026-02-24T18:17:45.640 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb85d1c6640 1 -- 10.20.193.52:0/1284923007 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8581a26b0 con 0x7fb858105070 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.525+0000 7fb85d1c6640 1 -- 10.20.193.52:0/1284923007 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8581054f0 con 0x7fb858105070 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.526+0000 7fb837fff640 1 -- 10.20.193.52:0/1284923007 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7fb84c0493b0 con 0x7fb858105070 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.526+0000 7fb837fff640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.526+0000 7fb837fff640 4 mgrc handle_mgr_map Got map version 7 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.526+0000 7fb837fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.526+0000 7fb837fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.526+0000 7fb837fff640 1 --2- 10.20.193.52:0/1284923007 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fb82c03dad0 0x7fb82c03ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.526+0000 7fb837fff640 1 -- 10.20.193.52:0/1284923007 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb84c076550 con 0x7fb858105070 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.526+0000 7fb856575640 1 --2- 10.20.193.52:0/1284923007 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fb82c03dad0 0x7fb82c03ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.526+0000 7fb856575640 1 --2- 10.20.193.52:0/1284923007 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fb82c03dad0 0x7fb82c03ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8400099c0 tx=0x7fb840006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.529+0000 7fb837fff640 1 -- 10.20.193.52:0/1284923007 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb84c043120 con 0x7fb858105070 2026-02-24T18:17:45.641 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.611+0000 7fb85d1c6640 20 mgrc start_command cmd: [{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}] 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.611+0000 7fb85d1c6640 1 -- 10.20.193.52:0/1284923007 --> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fb858196f50 con 0x7fb82c03dad0 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb837fff640 1 -- 10.20.193.52:0/1284923007 <== mgr.14118 v2:10.20.193.52:6800/3088300703 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fb858196f50 con 0x7fb82c03dad0 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb837fff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb85d1c6640 10 mgrc shutdown 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb85d1c6640 1 -- 10.20.193.52:0/1284923007 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fb82c03dad0 msgr2=0x7fb82c03ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb85d1c6640 1 --2- 10.20.193.52:0/1284923007 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fb82c03dad0 0x7fb82c03ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8400099c0 tx=0x7fb840006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb85d1c6640 1 -- 10.20.193.52:0/1284923007 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 msgr2=0x7fb85819f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb85d1c6640 1 --2- 10.20.193.52:0/1284923007 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb85819f1f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb84c006fd0 tx=0x7fb84c035570 comp rx=0 tx=0).stop 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb85d1c6640 1 -- 10.20.193.52:0/1284923007 shutdown_connections 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb85d1c6640 1 --2- 10.20.193.52:0/1284923007 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fb82c03dad0 0x7fb82c03ff90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.642 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb85d1c6640 1 --2- 10.20.193.52:0/1284923007 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb858105070 0x7fb85819f1f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.643 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb85d1c6640 1 -- 10.20.193.52:0/1284923007 >> 10.20.193.52:0/1284923007 conn(0x7fb858100be0 msgr2=0x7fb8581957d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:45.643 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.612+0000 7fb85d1c6640 1 -- 10.20.193.52:0/1284923007 shutdown_connections 2026-02-24T18:17:45.643 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.613+0000 7fb85d1c6640 1 -- 10.20.193.52:0/1284923007 wait complete. 2026-02-24T18:17:45.643 INFO:teuthology.orchestra.run.trial052.stdout:Generating ssh key... 2026-02-24T18:17:45.898 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.721+0000 7fecc4276640 1 Processor -- start 2026-02-24T18:17:45.898 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.721+0000 7fecc4276640 1 -- start start 2026-02-24T18:17:45.898 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.721+0000 7fecc4276640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.898 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.721+0000 7fecc4276640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fecbc109b50 con 0x7fecbc109180 2026-02-24T18:17:45.898 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.721+0000 7fecc1feb640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.898 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.721+0000 7fecc1feb640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58518/0 (socket says 10.20.193.52:58518) 2026-02-24T18:17:45.898 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.721+0000 7fecc1feb640 1 -- 10.20.193.52:0/785463312 learned_addr learned my addr 10.20.193.52:0/785463312 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:45.898 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.721+0000 7fecc1feb640 1 -- 10.20.193.52:0/785463312 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecbc10a2c0 con 0x7fecbc109180 2026-02-24T18:17:45.898 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc1feb640 1 --2- 10.20.193.52:0/785463312 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc109580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fecac009920 tx=0x7fecac02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3513072c942c921a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.898 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc0fe9640 1 -- 10.20.193.52:0/785463312 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecac03c070 con 0x7fecbc109180 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc0fe9640 1 -- 10.20.193.52:0/785463312 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fecac037440 con 0x7fecbc109180 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc0fe9640 1 -- 10.20.193.52:0/785463312 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecac035340 con 0x7fecbc109180 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc4276640 1 -- 10.20.193.52:0/785463312 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 msgr2=0x7fecbc109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc4276640 1 --2- 10.20.193.52:0/785463312 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc109580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fecac009920 tx=0x7fecac02ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc4276640 1 -- 10.20.193.52:0/785463312 shutdown_connections 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc4276640 1 --2- 10.20.193.52:0/785463312 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc109580 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc4276640 1 -- 10.20.193.52:0/785463312 >> 10.20.193.52:0/785463312 conn(0x7fecbc07c830 msgr2=0x7fecbc107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc4276640 1 -- 10.20.193.52:0/785463312 shutdown_connections 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.722+0000 7fecc4276640 1 -- 10.20.193.52:0/785463312 wait complete. 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc4276640 1 Processor -- start 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc4276640 1 -- start start 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc4276640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc19f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc4276640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fecbc10d4f0 con 0x7fecbc109180 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc1feb640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc19f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc1feb640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc19f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58534/0 (socket says 10.20.193.52:58534) 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc1feb640 1 -- 10.20.193.52:0/2915559952 learned_addr learned my addr 10.20.193.52:0/2915559952 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc1feb640 1 -- 10.20.193.52:0/2915559952 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecbc19f6f0 con 0x7fecbc109180 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc1feb640 1 --2- 10.20.193.52:0/2915559952 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc19f1b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecac02f4a0 tx=0x7fecac035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecaaffd640 1 -- 10.20.193.52:0/2915559952 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecac045070 con 0x7fecbc109180 2026-02-24T18:17:45.899 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecaaffd640 1 -- 10.20.193.52:0/2915559952 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fecac040450 con 0x7fecbc109180 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc4276640 1 -- 10.20.193.52:0/2915559952 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecbc19f980 con 0x7fecbc109180 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecaaffd640 1 -- 10.20.193.52:0/2915559952 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecac03c070 con 0x7fecbc109180 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.723+0000 7fecc4276640 1 -- 10.20.193.52:0/2915559952 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecbc1a2670 con 0x7fecbc109180 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.724+0000 7fecc4276640 1 -- 10.20.193.52:0/2915559952 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecbc109580 con 0x7fecbc109180 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.724+0000 7fecaaffd640 1 -- 10.20.193.52:0/2915559952 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7fecac0493b0 con 0x7fecbc109180 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.724+0000 7fecaaffd640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.724+0000 7fecaaffd640 4 mgrc handle_mgr_map Got map version 7 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.724+0000 7fecaaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.724+0000 7fecaaffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.724+0000 7fecaaffd640 1 --2- 10.20.193.52:0/2915559952 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fec9803dad0 0x7fec9803ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.724+0000 7fecaaffd640 1 -- 10.20.193.52:0/2915559952 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fecac076500 con 0x7fecbc109180 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.724+0000 7fecc17ea640 1 --2- 10.20.193.52:0/2915559952 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fec9803dad0 0x7fec9803ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.724+0000 7fecc17ea640 1 --2- 10.20.193.52:0/2915559952 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fec9803dad0 0x7fec9803ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fecb00099c0 tx=0x7fecb0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.726+0000 7fecaaffd640 1 -- 10.20.193.52:0/2915559952 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fecac04d120 con 0x7fecbc109180 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.809+0000 7fecc4276640 20 mgrc start_command cmd: [{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}] 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.809+0000 7fecc4276640 1 -- 10.20.193.52:0/2915559952 --> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fecbc107600 con 0x7fec9803dad0 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.828+0000 7fecaaffd640 1 -- 10.20.193.52:0/2915559952 <== mgr.14118 v2:10.20.193.52:6800/3088300703 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fecbc107600 con 0x7fec9803dad0 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.828+0000 7fecaaffd640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 10 mgrc shutdown 2026-02-24T18:17:45.900 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 1 -- 10.20.193.52:0/2915559952 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fec9803dad0 msgr2=0x7fec9803ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.901 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 1 --2- 10.20.193.52:0/2915559952 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fec9803dad0 0x7fec9803ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fecb00099c0 tx=0x7fecb0006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.901 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 1 -- 10.20.193.52:0/2915559952 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 msgr2=0x7fecbc19f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:45.901 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 1 --2- 10.20.193.52:0/2915559952 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc19f1b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecac02f4a0 tx=0x7fecac035f80 comp rx=0 tx=0).stop 2026-02-24T18:17:45.901 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 1 -- 10.20.193.52:0/2915559952 shutdown_connections 2026-02-24T18:17:45.901 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 1 --2- 10.20.193.52:0/2915559952 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fec9803dad0 0x7fec9803ff90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.901 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 1 --2- 10.20.193.52:0/2915559952 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fecbc109180 0x7fecbc19f1b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:45.901 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 1 -- 10.20.193.52:0/2915559952 >> 10.20.193.52:0/2915559952 conn(0x7fecbc07c830 msgr2=0x7fecbc106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:45.901 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 1 -- 10.20.193.52:0/2915559952 shutdown_connections 2026-02-24T18:17:45.901 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:45.829+0000 7fecc4276640 1 -- 10.20.193.52:0/2915559952 wait complete. 2026-02-24T18:17:46.011 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: Generating public/private ed25519 key pair. 2026-02-24T18:17:46.011 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: Your identification has been saved in /tmp/tmpokhebwh6/key 2026-02-24T18:17:46.011 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: Your public key has been saved in /tmp/tmpokhebwh6/key.pub 2026-02-24T18:17:46.011 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: The key fingerprint is: 2026-02-24T18:17:46.011 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: SHA256:v0vFaUgwIFdr0AueZ6JG4BcjEpbyQjBK9R5I5GzPu2Q ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:46.011 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: The key's randomart image is: 2026-02-24T18:17:46.011 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: +--[ED25519 256]--+ 2026-02-24T18:17:46.012 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: |=+++. +++ | 2026-02-24T18:17:46.012 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: |*+* =o...+ | 2026-02-24T18:17:46.012 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: |++ B * oo.. | 2026-02-24T18:17:46.012 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: |. + * =.+. o . | 2026-02-24T18:17:46.012 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: | . o = +S . = | 2026-02-24T18:17:46.012 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: | o . . o | 2026-02-24T18:17:46.012 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: | . E o | 2026-02-24T18:17:46.012 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: | o . . . | 2026-02-24T18:17:46.012 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: | . o. | 2026-02-24T18:17:46.012 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:45 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: +----[SHA256]-----+ 2026-02-24T18:17:46.593 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T18:17:46.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T18:17:46.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: [24/Feb/2026:18:17:45] ENGINE Bus STARTING 2026-02-24T18:17:46.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:46.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:46.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:17:46.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: [24/Feb/2026:18:17:45] ENGINE Serving on https://10.20.193.52:7150 2026-02-24T18:17:46.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: [24/Feb/2026:18:17:45] ENGINE Client ('10.20.193.52', 56246) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T18:17:46.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: [24/Feb/2026:18:17:45] ENGINE Serving on http://10.20.193.52:8765 2026-02-24T18:17:46.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: [24/Feb/2026:18:17:45] ENGINE Bus STARTED 2026-02-24T18:17:46.595 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:17:46.595 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:46.595 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:46 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:46.771 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN7aJuQqpHRUrI16SkJAodS0tKjnaZztF3QZc2MdedYR ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:46.772 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.258+0000 7f65997c2640 1 Processor -- start 2026-02-24T18:17:46.772 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.258+0000 7f65997c2640 1 -- start start 2026-02-24T18:17:46.772 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.258+0000 7f65997c2640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f6594109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:46.772 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.258+0000 7f65997c2640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6594109b50 con 0x7f6594109180 2026-02-24T18:17:46.772 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.259+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f6594109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:46.772 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.259+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f6594109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58542/0 (socket says 10.20.193.52:58542) 2026-02-24T18:17:46.772 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.259+0000 7f6592ffd640 1 -- 10.20.193.52:0/1968176664 learned_addr learned my addr 10.20.193.52:0/1968176664 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:46.772 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.259+0000 7f6592ffd640 1 -- 10.20.193.52:0/1968176664 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659410a2c0 con 0x7f6594109180 2026-02-24T18:17:46.772 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.259+0000 7f6592ffd640 1 --2- 10.20.193.52:0/1968176664 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f6594109580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6588009920 tx=0x7f658802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c09814297e51531 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:46.772 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.259+0000 7f6591ffb640 1 -- 10.20.193.52:0/1968176664 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658803c070 con 0x7f6594109180 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.259+0000 7f6591ffb640 1 -- 10.20.193.52:0/1968176664 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f6588037440 con 0x7f6594109180 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.259+0000 7f6591ffb640 1 -- 10.20.193.52:0/1968176664 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6588035340 con 0x7f6594109180 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 -- 10.20.193.52:0/1968176664 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 msgr2=0x7f6594109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 --2- 10.20.193.52:0/1968176664 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f6594109580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6588009920 tx=0x7f658802ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 -- 10.20.193.52:0/1968176664 shutdown_connections 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 --2- 10.20.193.52:0/1968176664 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f6594109580 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 -- 10.20.193.52:0/1968176664 >> 10.20.193.52:0/1968176664 conn(0x7f659407c830 msgr2=0x7f6594107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 -- 10.20.193.52:0/1968176664 shutdown_connections 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 -- 10.20.193.52:0/1968176664 wait complete. 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 Processor -- start 2026-02-24T18:17:46.773 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 -- start start 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f659419f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f65997c2640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f659410d4f0 con 0x7f6594109180 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f659419f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f6592ffd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f659419f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58544/0 (socket says 10.20.193.52:58544) 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f6592ffd640 1 -- 10.20.193.52:0/3875850910 learned_addr learned my addr 10.20.193.52:0/3875850910 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f6592ffd640 1 -- 10.20.193.52:0/3875850910 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659419f6f0 con 0x7f6594109180 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.260+0000 7f6592ffd640 1 --2- 10.20.193.52:0/3875850910 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f659419f1b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6588006fd0 tx=0x7f6588037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.261+0000 7f6573fff640 1 -- 10.20.193.52:0/3875850910 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6588045070 con 0x7f6594109180 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.261+0000 7f6573fff640 1 -- 10.20.193.52:0/3875850910 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f6588040450 con 0x7f6594109180 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.261+0000 7f65997c2640 1 -- 10.20.193.52:0/3875850910 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f659419f980 con 0x7f6594109180 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.261+0000 7f6573fff640 1 -- 10.20.193.52:0/3875850910 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658803c070 con 0x7f6594109180 2026-02-24T18:17:46.774 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.261+0000 7f65997c2640 1 -- 10.20.193.52:0/3875850910 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65941a2670 con 0x7f6594109180 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.261+0000 7f65997c2640 1 -- 10.20.193.52:0/3875850910 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6594109580 con 0x7f6594109180 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.261+0000 7f6573fff640 1 -- 10.20.193.52:0/3875850910 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7f658802fae0 con 0x7f6594109180 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.261+0000 7f6573fff640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.262+0000 7f6573fff640 4 mgrc handle_mgr_map Got map version 7 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.262+0000 7f6573fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.262+0000 7f6573fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.262+0000 7f6573fff640 1 --2- 10.20.193.52:0/3875850910 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f656803da80 0x7f656803ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.262+0000 7f65927fc640 1 --2- 10.20.193.52:0/3875850910 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f656803da80 0x7f656803ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.263+0000 7f6573fff640 1 -- 10.20.193.52:0/3875850910 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f65880765e0 con 0x7f6594109180 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.263+0000 7f65927fc640 1 --2- 10.20.193.52:0/3875850910 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f656803da80 0x7f656803ff40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f657c0099c0 tx=0x7f657c006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.264+0000 7f6573fff640 1 -- 10.20.193.52:0/3875850910 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f658804dd80 con 0x7f6594109180 2026-02-24T18:17:46.775 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.347+0000 7f65997c2640 20 mgrc start_command cmd: [{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}] 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.347+0000 7f65997c2640 1 -- 10.20.193.52:0/3875850910 --> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f6594107600 con 0x7f656803da80 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.348+0000 7f6573fff640 1 -- 10.20.193.52:0/3875850910 <== mgr.14118 v2:10.20.193.52:6800/3088300703 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+123 (secure 0 0 0) 0x7f6594107600 con 0x7f656803da80 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.348+0000 7f6573fff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 10 mgrc shutdown 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 1 -- 10.20.193.52:0/3875850910 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f656803da80 msgr2=0x7f656803ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 1 --2- 10.20.193.52:0/3875850910 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f656803da80 0x7f656803ff40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f657c0099c0 tx=0x7f657c006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 1 -- 10.20.193.52:0/3875850910 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 msgr2=0x7f659419f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 1 --2- 10.20.193.52:0/3875850910 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f659419f1b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6588006fd0 tx=0x7f6588037b70 comp rx=0 tx=0).stop 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 1 -- 10.20.193.52:0/3875850910 shutdown_connections 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 1 --2- 10.20.193.52:0/3875850910 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f656803da80 0x7f656803ff40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 1 --2- 10.20.193.52:0/3875850910 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f6594109180 0x7f659419f1b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:46.776 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 1 -- 10.20.193.52:0/3875850910 >> 10.20.193.52:0/3875850910 conn(0x7f659407c830 msgr2=0x7f6594106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:46.777 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 1 -- 10.20.193.52:0/3875850910 shutdown_connections 2026-02-24T18:17:46.777 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.349+0000 7f65997c2640 1 -- 10.20.193.52:0/3875850910 wait complete. 2026-02-24T18:17:46.777 INFO:teuthology.orchestra.run.trial052.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-24T18:17:46.777 INFO:teuthology.orchestra.run.trial052.stdout:Adding key to root@localhost authorized_keys... 2026-02-24T18:17:46.777 INFO:teuthology.orchestra.run.trial052.stdout:Adding host trial052... 2026-02-24T18:17:47.658 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:47 trial052 ceph-mon[39446]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:47.658 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:47 trial052 ceph-mon[39446]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:47.659 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:47 trial052 ceph-mon[39446]: Generating ssh key... 2026-02-24T18:17:47.659 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:47 trial052 ceph-mon[39446]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:47.659 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:47 trial052 ceph-mon[39446]: mgrmap e8: a(active, since 2s) 2026-02-24T18:17:48.510 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout Added host 'trial052' with addr '10.20.193.52' 2026-02-24T18:17:48.510 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.862+0000 7fa9b1019640 1 Processor -- start 2026-02-24T18:17:48.510 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.862+0000 7fa9b1019640 1 -- start start 2026-02-24T18:17:48.510 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.862+0000 7fa9b1019640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:48.510 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.862+0000 7fa9b1019640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac109b50 con 0x7fa9ac109180 2026-02-24T18:17:48.510 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.863+0000 7fa9aad76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:48.510 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.863+0000 7fa9aad76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58548/0 (socket says 10.20.193.52:58548) 2026-02-24T18:17:48.510 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.863+0000 7fa9aad76640 1 -- 10.20.193.52:0/2081703636 learned_addr learned my addr 10.20.193.52:0/2081703636 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:48.510 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.863+0000 7fa9aad76640 1 -- 10.20.193.52:0/2081703636 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ac10a2c0 con 0x7fa9ac109180 2026-02-24T18:17:48.510 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.863+0000 7fa9aad76640 1 --2- 10.20.193.52:0/2081703636 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac109580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009920 tx=0x7fa9a002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182ae6e7708f8fdc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.863+0000 7fa9a9d74640 1 -- 10.20.193.52:0/2081703636 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a003c070 con 0x7fa9ac109180 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.863+0000 7fa9a9d74640 1 -- 10.20.193.52:0/2081703636 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa9a0037440 con 0x7fa9ac109180 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.863+0000 7fa9a9d74640 1 -- 10.20.193.52:0/2081703636 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0035340 con 0x7fa9ac109180 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 -- 10.20.193.52:0/2081703636 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 msgr2=0x7fa9ac109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 --2- 10.20.193.52:0/2081703636 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac109580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009920 tx=0x7fa9a002ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 -- 10.20.193.52:0/2081703636 shutdown_connections 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 --2- 10.20.193.52:0/2081703636 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac109580 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 -- 10.20.193.52:0/2081703636 >> 10.20.193.52:0/2081703636 conn(0x7fa9ac07c830 msgr2=0x7fa9ac107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 -- 10.20.193.52:0/2081703636 shutdown_connections 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 -- 10.20.193.52:0/2081703636 wait complete. 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 Processor -- start 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 -- start start 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac19f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9b1019640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac10d4f0 con 0x7fa9ac109180 2026-02-24T18:17:48.511 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9aad76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac19f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9aad76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac19f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58558/0 (socket says 10.20.193.52:58558) 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.864+0000 7fa9aad76640 1 -- 10.20.193.52:0/34097027 learned_addr learned my addr 10.20.193.52:0/34097027 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.865+0000 7fa9aad76640 1 -- 10.20.193.52:0/34097027 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ac19f6f0 con 0x7fa9ac109180 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.865+0000 7fa9aad76640 1 --2- 10.20.193.52:0/34097027 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac19f1b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0006fd0 tx=0x7fa9a0037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.865+0000 7fa98bfff640 1 -- 10.20.193.52:0/34097027 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0045070 con 0x7fa9ac109180 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.865+0000 7fa98bfff640 1 -- 10.20.193.52:0/34097027 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa9a0040450 con 0x7fa9ac109180 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.865+0000 7fa9b1019640 1 -- 10.20.193.52:0/34097027 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ac19f980 con 0x7fa9ac109180 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.865+0000 7fa98bfff640 1 -- 10.20.193.52:0/34097027 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a003c070 con 0x7fa9ac109180 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.865+0000 7fa9b1019640 1 -- 10.20.193.52:0/34097027 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ac1a2670 con 0x7fa9ac109180 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.865+0000 7fa9b1019640 1 -- 10.20.193.52:0/34097027 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ac109580 con 0x7fa9ac109180 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.865+0000 7fa98bfff640 1 -- 10.20.193.52:0/34097027 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7fa9a00493b0 con 0x7fa9ac109180 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.865+0000 7fa98bfff640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.866+0000 7fa98bfff640 4 mgrc handle_mgr_map Got map version 8 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.866+0000 7fa98bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.866+0000 7fa98bfff640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.866+0000 7fa98bfff640 1 --2- 10.20.193.52:0/34097027 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa98003dba0 0x7fa980040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:48.512 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.866+0000 7fa98bfff640 1 -- 10.20.193.52:0/34097027 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa9a0076720 con 0x7fa9ac109180 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.866+0000 7fa9aa575640 1 --2- 10.20.193.52:0/34097027 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa98003dba0 0x7fa980040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.866+0000 7fa9aa575640 1 --2- 10.20.193.52:0/34097027 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa98003dba0 0x7fa980040060 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa9940099c0 tx=0x7fa994006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.868+0000 7fa98bfff640 1 -- 10.20.193.52:0/34097027 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa9a003c210 con 0x7fa9ac109180 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.952+0000 7fa9b1019640 20 mgrc start_command cmd: [{"prefix": "orch host add", "hostname": "trial052", "addr": "10.20.193.52", "target": ["mon-mgr", ""]}] 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:46.952+0000 7fa9b1019640 1 -- 10.20.193.52:0/34097027 --> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial052", "addr": "10.20.193.52", "target": ["mon-mgr", ""]}) -- 0x7fa9ac107600 con 0x7fa98003dba0 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.464+0000 7fa98bfff640 1 -- 10.20.193.52:0/34097027 <== mgr.14118 v2:10.20.193.52:6800/3088300703 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fa9ac107600 con 0x7fa98003dba0 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.464+0000 7fa98bfff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 10 mgrc shutdown 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 1 -- 10.20.193.52:0/34097027 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa98003dba0 msgr2=0x7fa980040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 1 --2- 10.20.193.52:0/34097027 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa98003dba0 0x7fa980040060 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa9940099c0 tx=0x7fa994006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 1 -- 10.20.193.52:0/34097027 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 msgr2=0x7fa9ac19f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 1 --2- 10.20.193.52:0/34097027 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac19f1b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0006fd0 tx=0x7fa9a0037b70 comp rx=0 tx=0).stop 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 1 -- 10.20.193.52:0/34097027 shutdown_connections 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 1 --2- 10.20.193.52:0/34097027 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa98003dba0 0x7fa980040060 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 1 --2- 10.20.193.52:0/34097027 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac109180 0x7fa9ac19f1b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 1 -- 10.20.193.52:0/34097027 >> 10.20.193.52:0/34097027 conn(0x7fa9ac07c830 msgr2=0x7fa9ac106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 1 -- 10.20.193.52:0/34097027 shutdown_connections 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.466+0000 7fa9b1019640 1 -- 10.20.193.52:0/34097027 wait complete. 2026-02-24T18:17:48.513 INFO:teuthology.orchestra.run.trial052.stdout:Deploying unmanaged mon service... 2026-02-24T18:17:48.714 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:48 trial052 ceph-mon[39446]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial052", "addr": "10.20.193.52", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:48.714 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:48 trial052 ceph-mon[39446]: Deploying cephadm binary to trial052 2026-02-24T18:17:48.743 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-24T18:17:48.744 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.616+0000 7efd3dba4640 1 Processor -- start 2026-02-24T18:17:48.744 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.616+0000 7efd3dba4640 1 -- start start 2026-02-24T18:17:48.744 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.616+0000 7efd3dba4640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd381094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:48.744 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.616+0000 7efd3dba4640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7efd38109aa0 con 0x7efd381090d0 2026-02-24T18:17:48.744 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.616+0000 7efd377fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd381094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:48.744 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.616+0000 7efd377fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd381094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58562/0 (socket says 10.20.193.52:58562) 2026-02-24T18:17:48.744 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.616+0000 7efd377fe640 1 -- 10.20.193.52:0/1055159249 learned_addr learned my addr 10.20.193.52:0/1055159249 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:48.744 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.616+0000 7efd377fe640 1 -- 10.20.193.52:0/1055159249 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3810a2d0 con 0x7efd381090d0 2026-02-24T18:17:48.744 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd377fe640 1 --2- 10.20.193.52:0/1055159249 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd381094d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efd24009920 tx=0x7efd2402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56919762868e895e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:48.744 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd367fc640 1 -- 10.20.193.52:0/1055159249 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd2403c070 con 0x7efd381090d0 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd367fc640 1 -- 10.20.193.52:0/1055159249 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7efd24037440 con 0x7efd381090d0 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd367fc640 1 -- 10.20.193.52:0/1055159249 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd24035340 con 0x7efd381090d0 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd3dba4640 1 -- 10.20.193.52:0/1055159249 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 msgr2=0x7efd381094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd3dba4640 1 --2- 10.20.193.52:0/1055159249 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd381094d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efd24009920 tx=0x7efd2402ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd3dba4640 1 -- 10.20.193.52:0/1055159249 shutdown_connections 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd3dba4640 1 --2- 10.20.193.52:0/1055159249 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd381094d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd3dba4640 1 -- 10.20.193.52:0/1055159249 >> 10.20.193.52:0/1055159249 conn(0x7efd3807ca50 msgr2=0x7efd38107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd3dba4640 1 -- 10.20.193.52:0/1055159249 shutdown_connections 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd3dba4640 1 -- 10.20.193.52:0/1055159249 wait complete. 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd3dba4640 1 Processor -- start 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.617+0000 7efd3dba4640 1 -- start start 2026-02-24T18:17:48.745 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd3dba4640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd3819f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd3dba4640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7efd3810d500 con 0x7efd381090d0 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd377fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd3819f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd377fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd3819f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58578/0 (socket says 10.20.193.52:58578) 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd377fe640 1 -- 10.20.193.52:0/3809812861 learned_addr learned my addr 10.20.193.52:0/3809812861 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd377fe640 1 -- 10.20.193.52:0/3809812861 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3819f6e0 con 0x7efd381090d0 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd377fe640 1 --2- 10.20.193.52:0/3809812861 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd3819f1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efd24006fd0 tx=0x7efd24037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd34ff9640 1 -- 10.20.193.52:0/3809812861 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd24045070 con 0x7efd381090d0 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd34ff9640 1 -- 10.20.193.52:0/3809812861 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7efd24040450 con 0x7efd381090d0 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd3dba4640 1 -- 10.20.193.52:0/3809812861 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3819f970 con 0x7efd381090d0 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd34ff9640 1 -- 10.20.193.52:0/3809812861 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd2403c070 con 0x7efd381090d0 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd3dba4640 1 -- 10.20.193.52:0/3809812861 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd381a2660 con 0x7efd381090d0 2026-02-24T18:17:48.746 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd34ff9640 1 -- 10.20.193.52:0/3809812861 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7efd240493b0 con 0x7efd381090d0 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd34ff9640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd3dba4640 1 -- 10.20.193.52:0/3809812861 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd3810d680 con 0x7efd381090d0 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd34ff9640 4 mgrc handle_mgr_map Got map version 8 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd34ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.618+0000 7efd34ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.619+0000 7efd34ff9640 1 --2- 10.20.193.52:0/3809812861 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7efd0c03db50 0x7efd0c040010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.619+0000 7efd34ff9640 1 -- 10.20.193.52:0/3809812861 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efd24076900 con 0x7efd381090d0 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.619+0000 7efd36ffd640 1 --2- 10.20.193.52:0/3809812861 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7efd0c03db50 0x7efd0c040010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.619+0000 7efd36ffd640 1 --2- 10.20.193.52:0/3809812861 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7efd0c03db50 0x7efd0c040010 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efd280099c0 tx=0x7efd28006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.621+0000 7efd34ff9640 1 -- 10.20.193.52:0/3809812861 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efd24076250 con 0x7efd381090d0 2026-02-24T18:17:48.747 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.711+0000 7efd3dba4640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}] 2026-02-24T18:17:48.748 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.711+0000 7efd3dba4640 1 -- 10.20.193.52:0/3809812861 --> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7efd3819fe50 con 0x7efd0c03db50 2026-02-24T18:17:48.748 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.714+0000 7efd34ff9640 1 -- 10.20.193.52:0/3809812861 <== mgr.14118 v2:10.20.193.52:6800/3088300703 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7efd3819fe50 con 0x7efd0c03db50 2026-02-24T18:17:48.748 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.714+0000 7efd34ff9640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:48.748 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 10 mgrc shutdown 2026-02-24T18:17:48.748 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 1 -- 10.20.193.52:0/3809812861 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7efd0c03db50 msgr2=0x7efd0c040010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:48.748 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 1 --2- 10.20.193.52:0/3809812861 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7efd0c03db50 0x7efd0c040010 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efd280099c0 tx=0x7efd28006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.748 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 1 -- 10.20.193.52:0/3809812861 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 msgr2=0x7efd3819f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:48.749 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 1 --2- 10.20.193.52:0/3809812861 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd3819f1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efd24006fd0 tx=0x7efd24037b70 comp rx=0 tx=0).stop 2026-02-24T18:17:48.749 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 1 -- 10.20.193.52:0/3809812861 shutdown_connections 2026-02-24T18:17:48.749 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 1 --2- 10.20.193.52:0/3809812861 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7efd0c03db50 0x7efd0c040010 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.749 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 1 --2- 10.20.193.52:0/3809812861 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7efd381090d0 0x7efd3819f1a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.749 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 1 -- 10.20.193.52:0/3809812861 >> 10.20.193.52:0/3809812861 conn(0x7efd3807ca50 msgr2=0x7efd38106e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:48.749 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 1 -- 10.20.193.52:0/3809812861 shutdown_connections 2026-02-24T18:17:48.749 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.715+0000 7efd3dba4640 1 -- 10.20.193.52:0/3809812861 wait complete. 2026-02-24T18:17:48.749 INFO:teuthology.orchestra.run.trial052.stdout:Deploying unmanaged mgr service... 2026-02-24T18:17:48.960 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.834+0000 7fc27e383640 1 Processor -- start 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.834+0000 7fc27e383640 1 -- start start 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.834+0000 7fc27e383640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc2781094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.834+0000 7fc27e383640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc278109aa0 con 0x7fc2781090d0 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.834+0000 7fc277fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc2781094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.834+0000 7fc277fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc2781094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58590/0 (socket says 10.20.193.52:58590) 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.834+0000 7fc277fff640 1 -- 10.20.193.52:0/230238765 learned_addr learned my addr 10.20.193.52:0/230238765 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.834+0000 7fc277fff640 1 -- 10.20.193.52:0/230238765 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27810a2d0 con 0x7fc2781090d0 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.834+0000 7fc277fff640 1 --2- 10.20.193.52:0/230238765 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc2781094d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc264009920 tx=0x7fc26402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794f9251c8e20662 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.834+0000 7fc276ffd640 1 -- 10.20.193.52:0/230238765 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc26403c070 con 0x7fc2781090d0 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc276ffd640 1 -- 10.20.193.52:0/230238765 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fc264037440 con 0x7fc2781090d0 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc276ffd640 1 -- 10.20.193.52:0/230238765 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc264035340 con 0x7fc2781090d0 2026-02-24T18:17:48.961 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 -- 10.20.193.52:0/230238765 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 msgr2=0x7fc2781094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 --2- 10.20.193.52:0/230238765 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc2781094d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc264009920 tx=0x7fc26402ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 -- 10.20.193.52:0/230238765 shutdown_connections 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 --2- 10.20.193.52:0/230238765 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc2781094d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 -- 10.20.193.52:0/230238765 >> 10.20.193.52:0/230238765 conn(0x7fc27807ca50 msgr2=0x7fc278107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 -- 10.20.193.52:0/230238765 shutdown_connections 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 -- 10.20.193.52:0/230238765 wait complete. 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 Processor -- start 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 -- start start 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc27819f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc27e383640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc27810d500 con 0x7fc2781090d0 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc277fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc27819f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc277fff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc27819f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58600/0 (socket says 10.20.193.52:58600) 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc277fff640 1 -- 10.20.193.52:0/830522876 learned_addr learned my addr 10.20.193.52:0/830522876 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.835+0000 7fc277fff640 1 -- 10.20.193.52:0/830522876 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27819f6e0 con 0x7fc2781090d0 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc277fff640 1 --2- 10.20.193.52:0/830522876 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc27819f1a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc264006fd0 tx=0x7fc264037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2757fa640 1 -- 10.20.193.52:0/830522876 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc264045070 con 0x7fc2781090d0 2026-02-24T18:17:48.962 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc27e383640 1 -- 10.20.193.52:0/830522876 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27819f970 con 0x7fc2781090d0 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2757fa640 1 -- 10.20.193.52:0/830522876 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fc264040450 con 0x7fc2781090d0 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2757fa640 1 -- 10.20.193.52:0/830522876 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc26403c070 con 0x7fc2781090d0 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc27e383640 1 -- 10.20.193.52:0/830522876 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2781a2660 con 0x7fc2781090d0 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2757fa640 1 -- 10.20.193.52:0/830522876 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7fc2640493b0 con 0x7fc2781090d0 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2757fa640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc27e383640 1 -- 10.20.193.52:0/830522876 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27810d680 con 0x7fc2781090d0 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2757fa640 4 mgrc handle_mgr_map Got map version 8 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2757fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2757fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2757fa640 1 --2- 10.20.193.52:0/830522876 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fc24c03db50 0x7fc24c040010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2757fa640 1 -- 10.20.193.52:0/830522876 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc2640767f0 con 0x7fc2781090d0 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.836+0000 7fc2777fe640 1 --2- 10.20.193.52:0/830522876 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fc24c03db50 0x7fc24c040010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.837+0000 7fc2777fe640 1 --2- 10.20.193.52:0/830522876 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fc24c03db50 0x7fc24c040010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2680099c0 tx=0x7fc268006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.839+0000 7fc2757fa640 1 -- 10.20.193.52:0/830522876 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc26403c210 con 0x7fc2781090d0 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.929+0000 7fc27e383640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}] 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.929+0000 7fc27e383640 1 -- 10.20.193.52:0/830522876 --> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc27819fe50 con 0x7fc24c03db50 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.932+0000 7fc2757fa640 1 -- 10.20.193.52:0/830522876 <== mgr.14118 v2:10.20.193.52:6800/3088300703 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc27819fe50 con 0x7fc24c03db50 2026-02-24T18:17:48.963 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.932+0000 7fc2757fa640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 10 mgrc shutdown 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 1 -- 10.20.193.52:0/830522876 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fc24c03db50 msgr2=0x7fc24c040010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 1 --2- 10.20.193.52:0/830522876 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fc24c03db50 0x7fc24c040010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2680099c0 tx=0x7fc268006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 1 -- 10.20.193.52:0/830522876 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 msgr2=0x7fc27819f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 1 --2- 10.20.193.52:0/830522876 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc27819f1a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc264006fd0 tx=0x7fc264037b70 comp rx=0 tx=0).stop 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 1 -- 10.20.193.52:0/830522876 shutdown_connections 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 1 --2- 10.20.193.52:0/830522876 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fc24c03db50 0x7fc24c040010 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 1 --2- 10.20.193.52:0/830522876 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc2781090d0 0x7fc27819f1a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 1 -- 10.20.193.52:0/830522876 >> 10.20.193.52:0/830522876 conn(0x7fc27807ca50 msgr2=0x7fc278106e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 1 -- 10.20.193.52:0/830522876 shutdown_connections 2026-02-24T18:17:48.964 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:48.934+0000 7fc27e383640 1 -- 10.20.193.52:0/830522876 wait complete. 2026-02-24T18:17:49.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.054+0000 7fefec993640 1 Processor -- start 2026-02-24T18:17:49.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.054+0000 7fefec993640 1 -- start start 2026-02-24T18:17:49.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.054+0000 7fefec993640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe407b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:49.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.054+0000 7fefec993640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fefe407b7f0 con 0x7fefe407ce50 2026-02-24T18:17:49.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.054+0000 7fefea708640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe407b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:49.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.054+0000 7fefea708640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe407b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58614/0 (socket says 10.20.193.52:58614) 2026-02-24T18:17:49.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.054+0000 7fefea708640 1 -- 10.20.193.52:0/3508024365 learned_addr learned my addr 10.20.193.52:0/3508024365 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:49.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.054+0000 7fefea708640 1 -- 10.20.193.52:0/3508024365 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe407b970 con 0x7fefe407ce50 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.054+0000 7fefea708640 1 --2- 10.20.193.52:0/3508024365 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe407b2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009920 tx=0x7fefdc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e275f16bd0c5d5c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefe9706640 1 -- 10.20.193.52:0/3508024365 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc03c070 con 0x7fefe407ce50 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefe9706640 1 -- 10.20.193.52:0/3508024365 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fefdc037440 con 0x7fefe407ce50 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefe9706640 1 -- 10.20.193.52:0/3508024365 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc0354d0 con 0x7fefe407ce50 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 -- 10.20.193.52:0/3508024365 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 msgr2=0x7fefe407b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 --2- 10.20.193.52:0/3508024365 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe407b2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009920 tx=0x7fefdc02ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 -- 10.20.193.52:0/3508024365 shutdown_connections 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 --2- 10.20.193.52:0/3508024365 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe407b2b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 -- 10.20.193.52:0/3508024365 >> 10.20.193.52:0/3508024365 conn(0x7fefe41025a0 msgr2=0x7fefe4104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 -- 10.20.193.52:0/3508024365 shutdown_connections 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 -- 10.20.193.52:0/3508024365 wait complete. 2026-02-24T18:17:49.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 Processor -- start 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 -- start start 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe419f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefec993640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fefe410d390 con 0x7fefe407ce50 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.055+0000 7fefea708640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe419f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefea708640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe419f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58624/0 (socket says 10.20.193.52:58624) 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefea708640 1 -- 10.20.193.52:0/584530667 learned_addr learned my addr 10.20.193.52:0/584530667 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefea708640 1 -- 10.20.193.52:0/584530667 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe419f730 con 0x7fefe407ce50 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefea708640 1 --2- 10.20.193.52:0/584530667 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe419f1f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fefdc02fcd0 tx=0x7fefdc02fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefcf7fe640 1 -- 10.20.193.52:0/584530667 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc047070 con 0x7fefe407ce50 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefcf7fe640 1 -- 10.20.193.52:0/584530667 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fefdc042440 con 0x7fefe407ce50 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefec993640 1 -- 10.20.193.52:0/584530667 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe419f9c0 con 0x7fefe407ce50 2026-02-24T18:17:49.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefcf7fe640 1 -- 10.20.193.52:0/584530667 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc03c070 con 0x7fefe407ce50 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefec993640 1 -- 10.20.193.52:0/584530667 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe41a26b0 con 0x7fefe407ce50 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefec993640 1 -- 10.20.193.52:0/584530667 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe407b330 con 0x7fefe407ce50 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefcf7fe640 1 -- 10.20.193.52:0/584530667 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7fefdc035b60 con 0x7fefe407ce50 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.056+0000 7fefcf7fe640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.057+0000 7fefcf7fe640 4 mgrc handle_mgr_map Got map version 8 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.057+0000 7fefcf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.057+0000 7fefcf7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.057+0000 7fefcf7fe640 1 --2- 10.20.193.52:0/584530667 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fefc003dba0 0x7fefc0040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.057+0000 7fefcf7fe640 1 -- 10.20.193.52:0/584530667 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fefdc076a20 con 0x7fefe407ce50 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.057+0000 7fefe9f07640 1 --2- 10.20.193.52:0/584530667 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fefc003dba0 0x7fefc0040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.057+0000 7fefe9f07640 1 --2- 10.20.193.52:0/584530667 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fefc003dba0 0x7fefc0040060 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefd00099c0 tx=0x7fefd0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:49.178 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.059+0000 7fefcf7fe640 1 -- 10.20.193.52:0/584530667 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fefdc04a360 con 0x7fefe407ce50 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.143+0000 7fefec993640 1 -- 10.20.193.52:0/584530667 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fefe4198800 con 0x7fefe407ce50 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.144+0000 7fefcf7fe640 1 -- 10.20.193.52:0/584530667 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fefdc045120 con 0x7fefe407ce50 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 10 mgrc shutdown 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 1 -- 10.20.193.52:0/584530667 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fefc003dba0 msgr2=0x7fefc0040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 1 --2- 10.20.193.52:0/584530667 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fefc003dba0 0x7fefc0040060 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefd00099c0 tx=0x7fefd0006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 1 -- 10.20.193.52:0/584530667 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 msgr2=0x7fefe419f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 1 --2- 10.20.193.52:0/584530667 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe419f1f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fefdc02fcd0 tx=0x7fefdc02fd00 comp rx=0 tx=0).stop 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 1 -- 10.20.193.52:0/584530667 shutdown_connections 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 1 --2- 10.20.193.52:0/584530667 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fefc003dba0 0x7fefc0040060 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 1 --2- 10.20.193.52:0/584530667 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fefe407ce50 0x7fefe419f1f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:49.179 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 1 -- 10.20.193.52:0/584530667 >> 10.20.193.52:0/584530667 conn(0x7fefe41025a0 msgr2=0x7fefe4103320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:49.180 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 1 -- 10.20.193.52:0/584530667 shutdown_connections 2026-02-24T18:17:49.180 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.146+0000 7fefec993640 1 -- 10.20.193.52:0/584530667 wait complete. 2026-02-24T18:17:49.380 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.265+0000 7fcd5eb9e640 1 Processor -- start 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.265+0000 7fcd5eb9e640 1 -- start start 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.265+0000 7fcd5eb9e640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd581094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.265+0000 7fcd5eb9e640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcd58109aa0 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.265+0000 7fcd5c913640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd581094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.265+0000 7fcd5c913640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd581094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58634/0 (socket says 10.20.193.52:58634) 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.265+0000 7fcd5c913640 1 -- 10.20.193.52:0/341324681 learned_addr learned my addr 10.20.193.52:0/341324681 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.266+0000 7fcd5c913640 1 -- 10.20.193.52:0/341324681 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5810a2f0 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.266+0000 7fcd5c913640 1 --2- 10.20.193.52:0/341324681 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd581094d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009920 tx=0x7fcd4802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3b55231bbae612 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.266+0000 7fcd4f7fe640 1 -- 10.20.193.52:0/341324681 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4803c070 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.266+0000 7fcd4f7fe640 1 -- 10.20.193.52:0/341324681 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fcd48037440 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.266+0000 7fcd4f7fe640 1 -- 10.20.193.52:0/341324681 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd480354d0 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/341324681 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 msgr2=0x7fcd581094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 --2- 10.20.193.52:0/341324681 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd581094d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009920 tx=0x7fcd4802ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/341324681 shutdown_connections 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 --2- 10.20.193.52:0/341324681 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd581094d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/341324681 >> 10.20.193.52:0/341324681 conn(0x7fcd5807c830 msgr2=0x7fcd58107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/341324681 shutdown_connections 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/341324681 wait complete. 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 Processor -- start 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 -- start start 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd5819f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5eb9e640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5810d520 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5c913640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd5819f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5c913640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd5819f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58642/0 (socket says 10.20.193.52:58642) 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5c913640 1 -- 10.20.193.52:0/2491846619 learned_addr learned my addr 10.20.193.52:0/2491846619 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5c913640 1 -- 10.20.193.52:0/2491846619 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5819f790 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.267+0000 7fcd5c913640 1 --2- 10.20.193.52:0/2491846619 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd5819f250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009a50 tx=0x7fcd4802fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd4dffb640 1 -- 10.20.193.52:0/2491846619 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd48047070 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd4dffb640 1 -- 10.20.193.52:0/2491846619 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fcd48042440 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/2491846619 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5819fa20 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd4dffb640 1 -- 10.20.193.52:0/2491846619 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4803c070 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/2491846619 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd581a2710 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/2491846619 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd5810d6a0 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd4dffb640 1 -- 10.20.193.52:0/2491846619 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7fcd48035b60 con 0x7fcd581090d0 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd4dffb640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd4dffb640 4 mgrc handle_mgr_map Got map version 8 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd4dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd4dffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:49.381 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.268+0000 7fcd4dffb640 1 --2- 10.20.193.52:0/2491846619 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcd3403dbf0 0x7fcd340400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.269+0000 7fcd4dffb640 1 -- 10.20.193.52:0/2491846619 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcd480768c0 con 0x7fcd581090d0 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.269+0000 7fcd4ffff640 1 --2- 10.20.193.52:0/2491846619 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcd3403dbf0 0x7fcd340400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.269+0000 7fcd4ffff640 1 --2- 10.20.193.52:0/2491846619 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcd3403dbf0 0x7fcd340400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcd400099c0 tx=0x7fcd40006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.271+0000 7fcd4dffb640 1 -- 10.20.193.52:0/2491846619 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcd4804a360 con 0x7fcd581090d0 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.354+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/2491846619 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fcd58198980 con 0x7fcd581090d0 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.356+0000 7fcd4dffb640 1 -- 10.20.193.52:0/2491846619 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fcd4804f120 con 0x7fcd581090d0 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 10 mgrc shutdown 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/2491846619 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcd3403dbf0 msgr2=0x7fcd340400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 1 --2- 10.20.193.52:0/2491846619 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcd3403dbf0 0x7fcd340400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcd400099c0 tx=0x7fcd40006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/2491846619 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 msgr2=0x7fcd5819f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 1 --2- 10.20.193.52:0/2491846619 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd5819f250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009a50 tx=0x7fcd4802fcb0 comp rx=0 tx=0).stop 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/2491846619 shutdown_connections 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 1 --2- 10.20.193.52:0/2491846619 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fcd3403dbf0 0x7fcd340400b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 1 --2- 10.20.193.52:0/2491846619 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fcd581090d0 0x7fcd5819f250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/2491846619 >> 10.20.193.52:0/2491846619 conn(0x7fcd5807c830 msgr2=0x7fcd58106f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/2491846619 shutdown_connections 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.357+0000 7fcd5eb9e640 1 -- 10.20.193.52:0/2491846619 wait complete. 2026-02-24T18:17:49.382 INFO:teuthology.orchestra.run.trial052.stdout:Enabling the dashboard module... 2026-02-24T18:17:49.590 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:49 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:49.590 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:49 trial052 ceph-mon[39446]: Added host trial052 2026-02-24T18:17:49.590 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:49 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:17:49.590 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:49 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:49.590 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:49 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:49.591 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:49 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:49.591 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:49 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:49.591 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:49 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/584530667' entity='client.admin' 2026-02-24T18:17:49.591 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:49 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2491846619' entity='client.admin' 2026-02-24T18:17:50.497 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.484+0000 7fa7a74fd640 1 Processor -- start 2026-02-24T18:17:50.497 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.484+0000 7fa7a74fd640 1 -- start start 2026-02-24T18:17:50.497 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.484+0000 7fa7a74fd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a007b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:50.497 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.484+0000 7fa7a74fd640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a007b7d0 con 0x7fa7a007ce30 2026-02-24T18:17:50.497 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.484+0000 7fa7a5272640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a007b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:50.497 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.484+0000 7fa7a5272640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a007b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58646/0 (socket says 10.20.193.52:58646) 2026-02-24T18:17:50.497 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.484+0000 7fa7a5272640 1 -- 10.20.193.52:0/1333874330 learned_addr learned my addr 10.20.193.52:0/1333874330 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:50.497 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.484+0000 7fa7a5272640 1 -- 10.20.193.52:0/1333874330 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a007b950 con 0x7fa7a007ce30 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a5272640 1 --2- 10.20.193.52:0/1333874330 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a007b290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa790009920 tx=0x7fa79002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bddfc0e8653760 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa78ffff640 1 -- 10.20.193.52:0/1333874330 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa79003c070 con 0x7fa7a007ce30 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa78ffff640 1 -- 10.20.193.52:0/1333874330 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa790037440 con 0x7fa7a007ce30 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa78ffff640 1 -- 10.20.193.52:0/1333874330 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7900354d0 con 0x7fa7a007ce30 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a74fd640 1 -- 10.20.193.52:0/1333874330 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 msgr2=0x7fa7a007b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a74fd640 1 --2- 10.20.193.52:0/1333874330 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a007b290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa790009920 tx=0x7fa79002ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a74fd640 1 -- 10.20.193.52:0/1333874330 shutdown_connections 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a74fd640 1 --2- 10.20.193.52:0/1333874330 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a007b290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a74fd640 1 -- 10.20.193.52:0/1333874330 >> 10.20.193.52:0/1333874330 conn(0x7fa7a01025a0 msgr2=0x7fa7a0104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a74fd640 1 -- 10.20.193.52:0/1333874330 shutdown_connections 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a74fd640 1 -- 10.20.193.52:0/1333874330 wait complete. 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a74fd640 1 Processor -- start 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a74fd640 1 -- start start 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.485+0000 7fa7a74fd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a019f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa7a74fd640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a010d3b0 con 0x7fa7a007ce30 2026-02-24T18:17:50.498 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa7a5272640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a019f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa7a5272640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a019f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58652/0 (socket says 10.20.193.52:58652) 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa7a5272640 1 -- 10.20.193.52:0/2810754521 learned_addr learned my addr 10.20.193.52:0/2810754521 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa7a5272640 1 -- 10.20.193.52:0/2810754521 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a019f740 con 0x7fa7a007ce30 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa7a5272640 1 --2- 10.20.193.52:0/2810754521 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a019f200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa79002fcd0 tx=0x7fa79002fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa78e7fc640 1 -- 10.20.193.52:0/2810754521 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa790047070 con 0x7fa7a007ce30 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa78e7fc640 1 -- 10.20.193.52:0/2810754521 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa790042440 con 0x7fa7a007ce30 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa7a74fd640 1 -- 10.20.193.52:0/2810754521 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a019f9d0 con 0x7fa7a007ce30 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa78e7fc640 1 -- 10.20.193.52:0/2810754521 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa79003c070 con 0x7fa7a007ce30 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa7a74fd640 1 -- 10.20.193.52:0/2810754521 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a01a26c0 con 0x7fa7a007ce30 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.486+0000 7fa7a74fd640 1 -- 10.20.193.52:0/2810754521 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a007b310 con 0x7fa7a007ce30 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.487+0000 7fa78e7fc640 1 -- 10.20.193.52:0/2810754521 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7fa790035b60 con 0x7fa7a007ce30 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.487+0000 7fa78e7fc640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.487+0000 7fa78e7fc640 4 mgrc handle_mgr_map Got map version 8 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.487+0000 7fa78e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.487+0000 7fa78e7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:50.499 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.487+0000 7fa78e7fc640 1 --2- 10.20.193.52:0/2810754521 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa77c03dbf0 0x7fa77c0400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.487+0000 7fa78e7fc640 1 -- 10.20.193.52:0/2810754521 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa790076980 con 0x7fa7a007ce30 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.487+0000 7fa7a4a71640 1 --2- 10.20.193.52:0/2810754521 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa77c03dbf0 0x7fa77c0400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.487+0000 7fa7a4a71640 1 --2- 10.20.193.52:0/2810754521 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa77c03dbf0 0x7fa77c0400b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa7940099c0 tx=0x7fa794006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.489+0000 7fa78e7fc640 1 -- 10.20.193.52:0/2810754521 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa79004a360 con 0x7fa7a007ce30 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:49.595+0000 7fa7a74fd640 1 -- 10.20.193.52:0/2810754521 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fa7a0198800 con 0x7fa7a007ce30 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.468+0000 7fa78e7fc640 1 -- 10.20.193.52:0/2810754521 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fa790045120 con 0x7fa7a007ce30 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.469+0000 7fa78e7fc640 1 -- 10.20.193.52:0/2810754521 <== mon.0 v2:10.20.193.52:3300/0 8 ==== mgrmap(e 9) ==== 50260+0+0 (secure 0 0 0) 0x7fa7900363a0 con 0x7fa7a007ce30 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.469+0000 7fa78e7fc640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.469+0000 7fa78e7fc640 4 mgrc handle_mgr_map Got map version 9 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.469+0000 7fa78e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 10 mgrc shutdown 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 1 -- 10.20.193.52:0/2810754521 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa77c03dbf0 msgr2=0x7fa77c0400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 1 --2- 10.20.193.52:0/2810754521 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa77c03dbf0 0x7fa77c0400b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa7940099c0 tx=0x7fa794006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 1 -- 10.20.193.52:0/2810754521 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 msgr2=0x7fa7a019f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 1 --2- 10.20.193.52:0/2810754521 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a019f200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa79002fcd0 tx=0x7fa79002fd00 comp rx=0 tx=0).stop 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 1 -- 10.20.193.52:0/2810754521 shutdown_connections 2026-02-24T18:17:50.500 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 1 --2- 10.20.193.52:0/2810754521 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7fa77c03dbf0 0x7fa77c0400b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:50.501 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 1 --2- 10.20.193.52:0/2810754521 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa7a007ce30 0x7fa7a019f200 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:50.501 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 1 -- 10.20.193.52:0/2810754521 >> 10.20.193.52:0/2810754521 conn(0x7fa7a01025a0 msgr2=0x7fa7a0103340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:50.501 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 1 -- 10.20.193.52:0/2810754521 shutdown_connections 2026-02-24T18:17:50.501 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.471+0000 7fa7a74fd640 1 -- 10.20.193.52:0/2810754521 wait complete. 2026-02-24T18:17:50.725 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:50 trial052 ceph-mon[39446]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:50.725 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:50 trial052 ceph-mon[39446]: Saving service mon spec with placement count:5 2026-02-24T18:17:50.725 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:50 trial052 ceph-mon[39446]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:50.725 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:50 trial052 ceph-mon[39446]: Saving service mgr spec with placement count:2 2026-02-24T18:17:50.725 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:50 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:50.725 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:50 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2810754521' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-24T18:17:50.725 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:50 trial052 ceph-mon[39446]: from='mgr.14118 10.20.193.52:0/2119182889' entity='mgr.a' 2026-02-24T18:17:50.725 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:50 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: ignoring --setuser ceph since I am not root 2026-02-24T18:17:50.725 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:50 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: ignoring --setgroup ceph since I am not root 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout { 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout } 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.602+0000 7f7014bb2640 1 Processor -- start 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.602+0000 7f7014bb2640 1 -- start start 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.602+0000 7f7014bb2640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f7010109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.602+0000 7f7014bb2640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7010109b50 con 0x7f7010109180 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.602+0000 7f700e575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f7010109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.602+0000 7f700e575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f7010109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58684/0 (socket says 10.20.193.52:58684) 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.602+0000 7f700e575640 1 -- 10.20.193.52:0/2769518802 learned_addr learned my addr 10.20.193.52:0/2769518802 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:50.740 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.602+0000 7f700e575640 1 -- 10.20.193.52:0/2769518802 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701010a2c0 con 0x7f7010109180 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f700e575640 1 --2- 10.20.193.52:0/2769518802 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f7010109580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7004009920 tx=0x7f700402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b266ac641db663 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f700d573640 1 -- 10.20.193.52:0/2769518802 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f700403c070 con 0x7f7010109180 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f700d573640 1 -- 10.20.193.52:0/2769518802 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7004037440 con 0x7f7010109180 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f700d573640 1 -- 10.20.193.52:0/2769518802 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70040354d0 con 0x7f7010109180 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f7014bb2640 1 -- 10.20.193.52:0/2769518802 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 msgr2=0x7f7010109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f7014bb2640 1 --2- 10.20.193.52:0/2769518802 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f7010109580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7004009920 tx=0x7f700402ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f7014bb2640 1 -- 10.20.193.52:0/2769518802 shutdown_connections 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f7014bb2640 1 --2- 10.20.193.52:0/2769518802 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f7010109580 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f7014bb2640 1 -- 10.20.193.52:0/2769518802 >> 10.20.193.52:0/2769518802 conn(0x7f701007c830 msgr2=0x7f7010107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f7014bb2640 1 -- 10.20.193.52:0/2769518802 shutdown_connections 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.603+0000 7f7014bb2640 1 -- 10.20.193.52:0/2769518802 wait complete. 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f7014bb2640 1 Processor -- start 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f7014bb2640 1 -- start start 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f7014bb2640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f701019f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f7014bb2640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f701010d4f0 con 0x7f7010109180 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f700e575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f701019f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f700e575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f701019f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58696/0 (socket says 10.20.193.52:58696) 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f700e575640 1 -- 10.20.193.52:0/2430818185 learned_addr learned my addr 10.20.193.52:0/2430818185 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f700e575640 1 -- 10.20.193.52:0/2430818185 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701019f6f0 con 0x7f7010109180 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f700e575640 1 --2- 10.20.193.52:0/2430818185 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f701019f1b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7004002410 tx=0x7f700402fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f6ff77fe640 1 -- 10.20.193.52:0/2430818185 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7004047070 con 0x7f7010109180 2026-02-24T18:17:50.741 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f7014bb2640 1 -- 10.20.193.52:0/2430818185 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701019f980 con 0x7f7010109180 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f6ff77fe640 1 -- 10.20.193.52:0/2430818185 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7004042440 con 0x7f7010109180 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f6ff77fe640 1 -- 10.20.193.52:0/2430818185 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f700403c070 con 0x7f7010109180 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.604+0000 7f7014bb2640 1 -- 10.20.193.52:0/2430818185 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70101a2670 con 0x7f7010109180 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.605+0000 7f7014bb2640 1 -- 10.20.193.52:0/2430818185 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7010109600 con 0x7f7010109180 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.605+0000 7f6ff77fe640 1 -- 10.20.193.52:0/2430818185 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 9) ==== 50260+0+0 (secure 0 0 0) 0x7f7004035b10 con 0x7f7010109180 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.605+0000 7f6ff77fe640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.605+0000 7f6ff77fe640 4 mgrc handle_mgr_map Got map version 9 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.605+0000 7f6ff77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.605+0000 7f6ff77fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.605+0000 7f6ff77fe640 1 --2- 10.20.193.52:0/2430818185 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f6fe803dbf0 0x7f6fe80400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.605+0000 7f700dd74640 1 -- 10.20.193.52:0/2430818185 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f6fe803dbf0 msgr2=0x7f6fe80400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.52:6800/3088300703 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.605+0000 7f6ff77fe640 1 -- 10.20.193.52:0/2430818185 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7004076a70 con 0x7f7010109180 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.605+0000 7f700dd74640 1 --2- 10.20.193.52:0/2430818185 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f6fe803dbf0 0x7f6fe80400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.608+0000 7f6ff77fe640 1 -- 10.20.193.52:0/2430818185 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f70040425f0 con 0x7f7010109180 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.713+0000 7f7014bb2640 1 -- 10.20.193.52:0/2430818185 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f70101a2840 con 0x7f7010109180 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.713+0000 7f6ff77fe640 1 -- 10.20.193.52:0/2430818185 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f7004035e30 con 0x7f7010109180 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 10 mgrc shutdown 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 1 -- 10.20.193.52:0/2430818185 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f6fe803dbf0 msgr2=0x7f6fe80400b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 1 --2- 10.20.193.52:0/2430818185 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f6fe803dbf0 0x7f6fe80400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:50.742 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 1 -- 10.20.193.52:0/2430818185 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 msgr2=0x7f701019f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:50.743 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 1 --2- 10.20.193.52:0/2430818185 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f701019f1b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7004002410 tx=0x7f700402fd20 comp rx=0 tx=0).stop 2026-02-24T18:17:50.743 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 1 -- 10.20.193.52:0/2430818185 shutdown_connections 2026-02-24T18:17:50.743 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 1 --2- 10.20.193.52:0/2430818185 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f6fe803dbf0 0x7f6fe80400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:50.743 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 1 --2- 10.20.193.52:0/2430818185 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7010109180 0x7f701019f1b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:50.743 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 1 -- 10.20.193.52:0/2430818185 >> 10.20.193.52:0/2430818185 conn(0x7f701007c830 msgr2=0x7f7010106e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:50.743 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 1 -- 10.20.193.52:0/2430818185 shutdown_connections 2026-02-24T18:17:50.743 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.714+0000 7f7014bb2640 1 -- 10.20.193.52:0/2430818185 wait complete. 2026-02-24T18:17:50.743 INFO:teuthology.orchestra.run.trial052.stdout:Waiting for the mgr to restart... 2026-02-24T18:17:50.743 INFO:teuthology.orchestra.run.trial052.stdout:Waiting for mgr epoch 9... 2026-02-24T18:17:51.034 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:50 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:50.885+0000 7f6e5b4be140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-24T18:17:51.035 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.031+0000 7f6e5b4be140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-24T18:17:51.312 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.067+0000 7f6e5b4be140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-24T18:17:51.312 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.108+0000 7f6e5b4be140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-24T18:17:51.312 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.140+0000 7f6e5b4be140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-24T18:17:51.313 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.174+0000 7f6e5b4be140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-24T18:17:51.313 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.240+0000 7f6e5b4be140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-24T18:17:51.313 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T18:17:51.313 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T18:17:51.313 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: from numpy import show_config as show_numpy_config 2026-02-24T18:17:51.572 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2810754521' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-24T18:17:51.572 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-mon[39446]: mgrmap e9: a(active, since 6s) 2026-02-24T18:17:51.572 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2430818185' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-24T18:17:51.572 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.313+0000 7f6e5b4be140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-24T18:17:51.572 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.347+0000 7f6e5b4be140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-24T18:17:51.572 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.443+0000 7f6e5b4be140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-24T18:17:51.572 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.503+0000 7f6e5b4be140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-24T18:17:51.572 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.537+0000 7f6e5b4be140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-24T18:17:51.572 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.569+0000 7f6e5b4be140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-24T18:17:51.870 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.604+0000 7f6e5b4be140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-24T18:17:51.871 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.634+0000 7f6e5b4be140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-24T18:17:51.871 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.868+0000 7f6e5b4be140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-24T18:17:52.126 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:51 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.968+0000 7f6e5b4be140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-24T18:17:52.126 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:52 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:51.999+0000 7f6e5b4be140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-24T18:17:52.126 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:52 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:52.029+0000 7f6e5b4be140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-24T18:17:52.126 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:52 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:52.123+0000 7f6e5b4be140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-24T18:17:52.465 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:52 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:52.153+0000 7f6e5b4be140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-24T18:17:52.465 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:52 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:52.246+0000 7f6e5b4be140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-24T18:17:53.140 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:52 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:52.712+0000 7f6e5b4be140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-24T18:17:53.141 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:52 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:52.742+0000 7f6e5b4be140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-24T18:17:53.141 INFO:journalctl@ceph.mgr.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-mgr-a[39715]: 2026-02-24T18:17:53.138+0000 7f6e5b4be140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: Active manager daemon a restarted 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: Activating manager daemon a 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: osdmap e3: 0 total, 0 up, 0 in 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: mgrmap e10: a(active, starting, since 0.00291444s) 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: Manager daemon a is now available 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-24T18:17:53.465 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:53 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout { 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout } 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.834+0000 7f703deda640 1 Processor -- start 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.834+0000 7f703deda640 1 -- start start 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.834+0000 7f703deda640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f7038109290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.834+0000 7f703deda640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f70381097d0 con 0x7f7038108e90 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.834+0000 7f703ced8640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f7038109290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.834+0000 7f703ced8640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f7038109290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58710/0 (socket says 10.20.193.52:58710) 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.834+0000 7f703ced8640 1 -- 10.20.193.52:0/1407260276 learned_addr learned my addr 10.20.193.52:0/1407260276 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:54.172 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.834+0000 7f703ced8640 1 -- 10.20.193.52:0/1407260276 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703810a080 con 0x7f7038108e90 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f703ced8640 1 --2- 10.20.193.52:0/1407260276 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f7038109290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7028009920 tx=0x7f702802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9c46bc5d5f990c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f702f7fe640 1 -- 10.20.193.52:0/1407260276 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702803c070 con 0x7f7038108e90 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f702f7fe640 1 -- 10.20.193.52:0/1407260276 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7028037440 con 0x7f7038108e90 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f702f7fe640 1 -- 10.20.193.52:0/1407260276 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70280354d0 con 0x7f7038108e90 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f703deda640 1 -- 10.20.193.52:0/1407260276 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 msgr2=0x7f7038109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f703deda640 1 --2- 10.20.193.52:0/1407260276 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f7038109290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7028009920 tx=0x7f702802ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f703deda640 1 -- 10.20.193.52:0/1407260276 shutdown_connections 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f703deda640 1 --2- 10.20.193.52:0/1407260276 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f7038109290 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f703deda640 1 -- 10.20.193.52:0/1407260276 >> 10.20.193.52:0/1407260276 conn(0x7f703807c3b0 msgr2=0x7f703807c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f703deda640 1 -- 10.20.193.52:0/1407260276 shutdown_connections 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.835+0000 7f703deda640 1 -- 10.20.193.52:0/1407260276 wait complete. 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703deda640 1 Processor -- start 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703deda640 1 -- start start 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703deda640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f703819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703deda640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7038109950 con 0x7f7038108e90 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703ced8640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f703819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703ced8640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f703819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58716/0 (socket says 10.20.193.52:58716) 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703ced8640 1 -- 10.20.193.52:0/1510106570 learned_addr learned my addr 10.20.193.52:0/1510106570 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703ced8640 1 -- 10.20.193.52:0/1510106570 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703819f550 con 0x7f7038108e90 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703ced8640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f703819f010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f702802fcb0 tx=0x7f702802fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.173 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7028047070 con 0x7f7038108e90 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7028042440 con 0x7f7038108e90 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703deda640 1 -- 10.20.193.52:0/1510106570 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703819f7e0 con 0x7f7038108e90 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702803c070 con 0x7f7038108e90 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.836+0000 7f703deda640 1 -- 10.20.193.52:0/1510106570 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70381a24d0 con 0x7f7038108e90 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f703deda640 20 mgrc start_tell_command target: cmd: [{"prefix": "get_command_descriptions"}] 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f703deda640 5 mgrc start_tell_command no mgr session (no running mgr daemon?), or not active mgr, waiting 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 9) ==== 50260+0+0 (secure 0 0 0) 0x7f7028035b10 con 0x7f7038108e90 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702dffb640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702dffb640 4 mgrc handle_mgr_map Got map version 9 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702dffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702dffb640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 0x7f7014040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702dffb640 10 mgrc reconnect resending 0 (tell) 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 --> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7014040810 con 0x7f701403dc40 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f70280767c0 con 0x7f7038108e90 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702ffff640 1 -- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 msgr2=0x7f7014040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.52:6800/3088300703 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:50.837+0000 7f702ffff640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 0x7f7014040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:51.038+0000 7f702ffff640 1 -- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 msgr2=0x7f7014040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.52:6800/3088300703 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:51.038+0000 7f702ffff640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 0x7f7014040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:51.439+0000 7f702ffff640 1 -- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 msgr2=0x7f7014040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.52:6800/3088300703 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:51.439+0000 7f702ffff640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 0x7f7014040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T18:17:54.174 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:52.240+0000 7f702ffff640 1 -- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 msgr2=0x7f7014040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.52:6800/3088300703 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:52.240+0000 7f702ffff640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 0x7f7014040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:53.141+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mgrmap(e 10) ==== 50027+0+0 (secure 0 0 0) 0x7f70280755c0 con 0x7f7038108e90 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:53.141+0000 7f702dffb640 20 mgrc handle_mgr_map mgrmap(e 10) 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:53.141+0000 7f702dffb640 4 mgrc handle_mgr_map Got map version 10 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:53.141+0000 7f702dffb640 4 mgrc handle_mgr_map Active mgr is now 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:53.141+0000 7f702dffb640 4 mgrc reconnect Terminating session with v2:10.20.193.52:6800/3088300703 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:53.141+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 msgr2=0x7f7014040100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:53.141+0000 7f702dffb640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 0x7f7014040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:53.141+0000 7f702dffb640 4 mgrc reconnect No active mgr available yet 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.142+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mgrmap(e 11) ==== 50154+0+0 (secure 0 0 0) 0x7f7028075cc0 con 0x7f7038108e90 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.142+0000 7f702dffb640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.142+0000 7f702dffb640 4 mgrc handle_mgr_map Got map version 11 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.142+0000 7f702dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.142+0000 7f702dffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.142+0000 7f702dffb640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7014041720 0x7f7014043b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.175 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.142+0000 7f702dffb640 10 mgrc reconnect resending 0 (tell) 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.142+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7028031e50 con 0x7f7014041720 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.142+0000 7f702ffff640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7014041720 0x7f7014043b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.143+0000 7f702ffff640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7014041720 0x7f7014043b10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7020003a80 tx=0x7f70200092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.143+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f7028031e50 con 0x7f7014041720 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.143+0000 7f702dffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.146+0000 7f703deda640 20 mgrc start_tell_command target: cmd: [{"prefix": "mgr_status"}] 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.146+0000 7f703deda640 1 -- 10.20.193.52:0/1510106570 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f703819fcc0 con 0x7f7014041720 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f702dffb640 1 -- 10.20.193.52:0/1510106570 <== mgr.14150 v2:10.20.193.52:6800/2288435215 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f703819fcc0 con 0x7f7014041720 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f702dffb640 20 mgrc handle_command_reply tid 1 r 0 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 10 mgrc shutdown 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 -- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7014041720 msgr2=0x7f7014043b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7014041720 0x7f7014043b10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7020003a80 tx=0x7f70200092b0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 -- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 msgr2=0x7f703819f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.176 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f703819f010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f702802fcb0 tx=0x7f702802fce0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 -- 10.20.193.52:0/1510106570 shutdown_connections 2026-02-24T18:17:54.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7014041720 0x7f7014043b10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:6800/3088300703,v1:10.20.193.52:6801/3088300703] conn(0x7f701403dc40 0x7f7014040100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 --2- 10.20.193.52:0/1510106570 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7038108e90 0x7f703819f010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 -- 10.20.193.52:0/1510106570 >> 10.20.193.52:0/1510106570 conn(0x7f703807c3b0 msgr2=0x7f7038106840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:54.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 -- 10.20.193.52:0/1510106570 shutdown_connections 2026-02-24T18:17:54.177 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.147+0000 7f703deda640 1 -- 10.20.193.52:0/1510106570 wait complete. 2026-02-24T18:17:54.177 INFO:teuthology.orchestra.run.trial052.stdout:mgr epoch 9 is available 2026-02-24T18:17:54.177 INFO:teuthology.orchestra.run.trial052.stdout:Generating a dashboard self-signed certificate... 2026-02-24T18:17:54.426 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-24T18:17:54.426 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.269+0000 7fc74d239640 1 Processor -- start 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.269+0000 7fc74d239640 1 -- start start 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.269+0000 7fc74d239640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc748109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.269+0000 7fc74d239640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc748109b50 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.270+0000 7fc746d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc748109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.270+0000 7fc746d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc748109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58808/0 (socket says 10.20.193.52:58808) 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.270+0000 7fc746d76640 1 -- 10.20.193.52:0/3743118817 learned_addr learned my addr 10.20.193.52:0/3743118817 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.270+0000 7fc746d76640 1 -- 10.20.193.52:0/3743118817 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74810a2c0 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.270+0000 7fc746d76640 1 --2- 10.20.193.52:0/3743118817 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc748109580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009920 tx=0x7fc73c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ba1c3f24431e65 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc745d74640 1 -- 10.20.193.52:0/3743118817 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73c03c070 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc745d74640 1 -- 10.20.193.52:0/3743118817 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc73c037440 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc745d74640 1 -- 10.20.193.52:0/3743118817 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73c0354d0 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 -- 10.20.193.52:0/3743118817 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 msgr2=0x7fc748109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 --2- 10.20.193.52:0/3743118817 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc748109580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009920 tx=0x7fc73c02ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 -- 10.20.193.52:0/3743118817 shutdown_connections 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 --2- 10.20.193.52:0/3743118817 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc748109580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 -- 10.20.193.52:0/3743118817 >> 10.20.193.52:0/3743118817 conn(0x7fc74807c830 msgr2=0x7fc748107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 -- 10.20.193.52:0/3743118817 shutdown_connections 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 -- 10.20.193.52:0/3743118817 wait complete. 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 Processor -- start 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 -- start start 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc74819f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc74d239640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc74810d4f0 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc746d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc74819f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc746d76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc74819f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58820/0 (socket says 10.20.193.52:58820) 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.271+0000 7fc746d76640 1 -- 10.20.193.52:0/3578379385 learned_addr learned my addr 10.20.193.52:0/3578379385 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc746d76640 1 -- 10.20.193.52:0/3578379385 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74819f6f0 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc746d76640 1 --2- 10.20.193.52:0/3578379385 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc74819f1b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc73c037d90 tx=0x7fc73c02fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc727fff640 1 -- 10.20.193.52:0/3578379385 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73c047070 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc74d239640 1 -- 10.20.193.52:0/3578379385 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc74819f980 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc727fff640 1 -- 10.20.193.52:0/3578379385 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc73c035c20 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc727fff640 1 -- 10.20.193.52:0/3578379385 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73c03c070 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc74d239640 1 -- 10.20.193.52:0/3578379385 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7481a2670 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc74d239640 1 -- 10.20.193.52:0/3578379385 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc748109600 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc727fff640 1 -- 10.20.193.52:0/3578379385 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 11) ==== 50154+0+0 (secure 0 0 0) 0x7fc73c042440 con 0x7fc748109180 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc727fff640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc727fff640 4 mgrc handle_mgr_map Got map version 11 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc727fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:54.427 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc727fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.272+0000 7fc727fff640 1 --2- 10.20.193.52:0/3578379385 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc71c03dad0 0x7fc71c03ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.273+0000 7fc727fff640 1 -- 10.20.193.52:0/3578379385 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc73c076d00 con 0x7fc748109180 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.273+0000 7fc746575640 1 --2- 10.20.193.52:0/3578379385 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc71c03dad0 0x7fc71c03ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.273+0000 7fc746575640 1 --2- 10.20.193.52:0/3578379385 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc71c03dad0 0x7fc71c03ff90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc7300099c0 tx=0x7fc730006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.275+0000 7fc727fff640 1 -- 10.20.193.52:0/3578379385 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc73c04be80 con 0x7fc748109180 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.359+0000 7fc74d239640 20 mgrc start_command cmd: [{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}] 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.359+0000 7fc74d239640 1 -- 10.20.193.52:0/3578379385 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fc748107580 con 0x7fc71c03dad0 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.403+0000 7fc727fff640 1 -- 10.20.193.52:0/3578379385 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fc748107580 con 0x7fc71c03dad0 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.403+0000 7fc727fff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 10 mgrc shutdown 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 1 -- 10.20.193.52:0/3578379385 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc71c03dad0 msgr2=0x7fc71c03ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 1 --2- 10.20.193.52:0/3578379385 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc71c03dad0 0x7fc71c03ff90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc7300099c0 tx=0x7fc730006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 1 -- 10.20.193.52:0/3578379385 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 msgr2=0x7fc74819f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 1 --2- 10.20.193.52:0/3578379385 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc74819f1b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc73c037d90 tx=0x7fc73c02fd40 comp rx=0 tx=0).stop 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 1 -- 10.20.193.52:0/3578379385 shutdown_connections 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 1 --2- 10.20.193.52:0/3578379385 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc71c03dad0 0x7fc71c03ff90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 1 --2- 10.20.193.52:0/3578379385 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc748109180 0x7fc74819f1b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 1 -- 10.20.193.52:0/3578379385 >> 10.20.193.52:0/3578379385 conn(0x7fc74807c830 msgr2=0x7fc748106e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 1 -- 10.20.193.52:0/3578379385 shutdown_connections 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.404+0000 7fc74d239640 1 -- 10.20.193.52:0/3578379385 wait complete. 2026-02-24T18:17:54.428 INFO:teuthology.orchestra.run.trial052.stdout:Creating initial admin user... 2026-02-24T18:17:54.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:54.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:54.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: [24/Feb/2026:18:17:53] ENGINE Bus STARTING 2026-02-24T18:17:54.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: [24/Feb/2026:18:17:54] ENGINE Serving on http://10.20.193.52:8765 2026-02-24T18:17:54.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T18:17:54.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: mgrmap e11: a(active, since 1.00471s) 2026-02-24T18:17:54.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T18:17:54.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: [24/Feb/2026:18:17:54] ENGINE Serving on https://10.20.193.52:7150 2026-02-24T18:17:54.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: [24/Feb/2026:18:17:54] ENGINE Bus STARTED 2026-02-24T18:17:54.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: [24/Feb/2026:18:17:54] ENGINE Client ('10.20.193.52', 56266) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T18:17:54.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:54.717 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:54.717 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:54 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:54.787 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$GUHR0yR8RyGFvg3ulMzJDuVN1S.oecli8O.yJFbDg2pXRWYi070Ri", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771957074, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-24T18:17:54.787 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.517+0000 7fc9b5e4a640 1 Processor -- start 2026-02-24T18:17:54.788 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.517+0000 7fc9b5e4a640 1 -- start start 2026-02-24T18:17:54.788 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.517+0000 7fc9b5e4a640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b0107230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.788 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.517+0000 7fc9b5e4a640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b0107770 con 0x7fc9b0106e30 2026-02-24T18:17:54.788 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.517+0000 7fc9af7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b0107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.788 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.517+0000 7fc9af7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b0107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58832/0 (socket says 10.20.193.52:58832) 2026-02-24T18:17:54.788 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.517+0000 7fc9af7fe640 1 -- 10.20.193.52:0/2989463940 learned_addr learned my addr 10.20.193.52:0/2989463940 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:54.788 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.517+0000 7fc9af7fe640 1 -- 10.20.193.52:0/2989463940 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b0107f90 con 0x7fc9b0106e30 2026-02-24T18:17:54.788 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.517+0000 7fc9af7fe640 1 --2- 10.20.193.52:0/2989463940 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b0107230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009920 tx=0x7fc99c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ab45969c21e0c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.789 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9ae7fc640 1 -- 10.20.193.52:0/2989463940 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc99c03c070 con 0x7fc9b0106e30 2026-02-24T18:17:54.789 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9ae7fc640 1 -- 10.20.193.52:0/2989463940 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc99c037440 con 0x7fc9b0106e30 2026-02-24T18:17:54.789 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9ae7fc640 1 -- 10.20.193.52:0/2989463940 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc99c0354d0 con 0x7fc9b0106e30 2026-02-24T18:17:54.789 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/2989463940 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 msgr2=0x7fc9b0107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.789 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 --2- 10.20.193.52:0/2989463940 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b0107230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009920 tx=0x7fc99c02ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:54.789 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/2989463940 shutdown_connections 2026-02-24T18:17:54.789 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 --2- 10.20.193.52:0/2989463940 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b0107230 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.789 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/2989463940 >> 10.20.193.52:0/2989463940 conn(0x7fc9b01025c0 msgr2=0x7fc9b0104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:54.789 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/2989463940 shutdown_connections 2026-02-24T18:17:54.790 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/2989463940 wait complete. 2026-02-24T18:17:54.790 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 Processor -- start 2026-02-24T18:17:54.790 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 -- start start 2026-02-24T18:17:54.790 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b019f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.790 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9b5e4a640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b010b250 con 0x7fc9b0106e30 2026-02-24T18:17:54.790 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9af7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b019f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.790 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9af7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b019f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58846/0 (socket says 10.20.193.52:58846) 2026-02-24T18:17:54.790 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.518+0000 7fc9af7fe640 1 -- 10.20.193.52:0/4285645008 learned_addr learned my addr 10.20.193.52:0/4285645008 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:54.790 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.519+0000 7fc9af7fe640 1 -- 10.20.193.52:0/4285645008 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b019f690 con 0x7fc9b0106e30 2026-02-24T18:17:54.790 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.519+0000 7fc9af7fe640 1 --2- 10.20.193.52:0/4285645008 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b019f150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc99c002410 tx=0x7fc99c02fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.519+0000 7fc9acff9640 1 -- 10.20.193.52:0/4285645008 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc99c047070 con 0x7fc9b0106e30 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.519+0000 7fc9acff9640 1 -- 10.20.193.52:0/4285645008 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc99c042440 con 0x7fc9b0106e30 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.519+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/4285645008 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b019f920 con 0x7fc9b0106e30 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.519+0000 7fc9acff9640 1 -- 10.20.193.52:0/4285645008 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc99c03c070 con 0x7fc9b0106e30 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.519+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/4285645008 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b01a2610 con 0x7fc9b0106e30 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.519+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/4285645008 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b01072b0 con 0x7fc9b0106e30 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.519+0000 7fc9acff9640 1 -- 10.20.193.52:0/4285645008 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 11) ==== 50154+0+0 (secure 0 0 0) 0x7fc99c035b10 con 0x7fc9b0106e30 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.519+0000 7fc9acff9640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.520+0000 7fc9acff9640 4 mgrc handle_mgr_map Got map version 11 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.520+0000 7fc9acff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:54.791 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.520+0000 7fc9acff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:54.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.520+0000 7fc9acff9640 1 --2- 10.20.193.52:0/4285645008 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc98403dad0 0x7fc98403ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.520+0000 7fc9acff9640 1 -- 10.20.193.52:0/4285645008 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc99c076c20 con 0x7fc9b0106e30 2026-02-24T18:17:54.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.520+0000 7fc9aeffd640 1 --2- 10.20.193.52:0/4285645008 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc98403dad0 0x7fc98403ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.520+0000 7fc9aeffd640 1 --2- 10.20.193.52:0/4285645008 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc98403dad0 0x7fc98403ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00099c0 tx=0x7fc9a0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.522+0000 7fc9acff9640 1 -- 10.20.193.52:0/4285645008 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc99c04a360 con 0x7fc9b0106e30 2026-02-24T18:17:54.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.610+0000 7fc9b5e4a640 20 mgrc start_command cmd: [{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}] 2026-02-24T18:17:54.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.610+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/4285645008 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fc9b0103870 con 0x7fc98403dad0 2026-02-24T18:17:54.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.753+0000 7fc9acff9640 1 -- 10.20.193.52:0/4285645008 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fc9b0103870 con 0x7fc98403dad0 2026-02-24T18:17:54.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.753+0000 7fc9acff9640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:54.792 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 10 mgrc shutdown 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/4285645008 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc98403dad0 msgr2=0x7fc98403ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 1 --2- 10.20.193.52:0/4285645008 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc98403dad0 0x7fc98403ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00099c0 tx=0x7fc9a0006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/4285645008 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 msgr2=0x7fc9b019f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 1 --2- 10.20.193.52:0/4285645008 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b019f150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc99c002410 tx=0x7fc99c02fd20 comp rx=0 tx=0).stop 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/4285645008 shutdown_connections 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 1 --2- 10.20.193.52:0/4285645008 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc98403dad0 0x7fc98403ff90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 1 --2- 10.20.193.52:0/4285645008 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc9b0106e30 0x7fc9b019f150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/4285645008 >> 10.20.193.52:0/4285645008 conn(0x7fc9b01025c0 msgr2=0x7fc9b0103160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/4285645008 shutdown_connections 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.754+0000 7fc9b5e4a640 1 -- 10.20.193.52:0/4285645008 wait complete. 2026-02-24T18:17:54.793 INFO:teuthology.orchestra.run.trial052.stdout:Fetching dashboard port number... 2026-02-24T18:17:54.987 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stdout 8443 2026-02-24T18:17:54.987 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.870+0000 7f3dacc05640 1 Processor -- start 2026-02-24T18:17:54.987 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.870+0000 7f3dacc05640 1 -- start start 2026-02-24T18:17:54.987 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.870+0000 7f3dacc05640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da81094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.870+0000 7f3dacc05640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3da8109aa0 con 0x7f3da81090d0 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.870+0000 7f3da6575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da81094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.870+0000 7f3da6575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da81094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58856/0 (socket says 10.20.193.52:58856) 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.870+0000 7f3da6575640 1 -- 10.20.193.52:0/559569329 learned_addr learned my addr 10.20.193.52:0/559569329 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.870+0000 7f3da6575640 1 -- 10.20.193.52:0/559569329 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da810a2d0 con 0x7f3da81090d0 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3da6575640 1 --2- 10.20.193.52:0/559569329 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da81094d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009e80 tx=0x7f3d9c02f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee1cb14b83136df server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3da5573640 1 -- 10.20.193.52:0/559569329 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d9c02fb60 con 0x7f3da81090d0 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3da5573640 1 -- 10.20.193.52:0/559569329 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3d9c02fd00 con 0x7f3da81090d0 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3da5573640 1 -- 10.20.193.52:0/559569329 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d9c007580 con 0x7f3da81090d0 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3dacc05640 1 -- 10.20.193.52:0/559569329 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 msgr2=0x7f3da81094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.988 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3dacc05640 1 --2- 10.20.193.52:0/559569329 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da81094d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009e80 tx=0x7f3d9c02f360 comp rx=0 tx=0).stop 2026-02-24T18:17:54.989 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3dacc05640 1 -- 10.20.193.52:0/559569329 shutdown_connections 2026-02-24T18:17:54.989 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3dacc05640 1 --2- 10.20.193.52:0/559569329 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da81094d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.989 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3dacc05640 1 -- 10.20.193.52:0/559569329 >> 10.20.193.52:0/559569329 conn(0x7f3da807ca50 msgr2=0x7f3da8107620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:54.989 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3dacc05640 1 -- 10.20.193.52:0/559569329 shutdown_connections 2026-02-24T18:17:54.989 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.871+0000 7f3dacc05640 1 -- 10.20.193.52:0/559569329 wait complete. 2026-02-24T18:17:54.989 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3dacc05640 1 Processor -- start 2026-02-24T18:17:54.989 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3dacc05640 1 -- start start 2026-02-24T18:17:54.989 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3dacc05640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da819f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.989 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3dacc05640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3da810d500 con 0x7f3da81090d0 2026-02-24T18:17:54.989 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3da6575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da819f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3da6575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da819f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:58862/0 (socket says 10.20.193.52:58862) 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3da6575640 1 -- 10.20.193.52:0/2805975932 learned_addr learned my addr 10.20.193.52:0/2805975932 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3da6575640 1 -- 10.20.193.52:0/2805975932 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da819f6b0 con 0x7f3da81090d0 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3da6575640 1 --2- 10.20.193.52:0/2805975932 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da819f170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c039040 tx=0x7f3d9c037620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3d8f7fe640 1 -- 10.20.193.52:0/2805975932 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d9c045020 con 0x7f3da81090d0 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3d8f7fe640 1 -- 10.20.193.52:0/2805975932 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3d9c007c10 con 0x7f3da81090d0 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3dacc05640 1 -- 10.20.193.52:0/2805975932 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da819f940 con 0x7f3da81090d0 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3d8f7fe640 1 -- 10.20.193.52:0/2805975932 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d9c03f3d0 con 0x7f3da81090d0 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.872+0000 7f3dacc05640 1 -- 10.20.193.52:0/2805975932 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da81a2630 con 0x7f3da81090d0 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.873+0000 7f3dacc05640 1 -- 10.20.193.52:0/2805975932 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da810d680 con 0x7f3da81090d0 2026-02-24T18:17:54.990 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.873+0000 7f3d8f7fe640 1 -- 10.20.193.52:0/2805975932 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 11) ==== 50154+0+0 (secure 0 0 0) 0x7f3d9c041400 con 0x7f3da81090d0 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.873+0000 7f3d8f7fe640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.873+0000 7f3d8f7fe640 4 mgrc handle_mgr_map Got map version 11 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.873+0000 7f3d8f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.873+0000 7f3d8f7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.873+0000 7f3d8f7fe640 1 --2- 10.20.193.52:0/2805975932 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3d8003db20 0x7f3d8003ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.873+0000 7f3d8f7fe640 1 -- 10.20.193.52:0/2805975932 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3d9c077aa0 con 0x7f3da81090d0 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.873+0000 7f3da5d74640 1 --2- 10.20.193.52:0/2805975932 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3d8003db20 0x7f3d8003ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.873+0000 7f3da5d74640 1 --2- 10.20.193.52:0/2805975932 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3d8003db20 0x7f3d8003ffe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3d900099c0 tx=0x7f3d90006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.876+0000 7f3d8f7fe640 1 -- 10.20.193.52:0/2805975932 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3d9c04f030 con 0x7f3da81090d0 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.959+0000 7f3dacc05640 1 -- 10.20.193.52:0/2805975932 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f3da81a2800 con 0x7f3da81090d0 2026-02-24T18:17:54.991 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.959+0000 7f3d8f7fe640 1 -- 10.20.193.52:0/2805975932 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f3d9c03d2d0 con 0x7f3da81090d0 2026-02-24T18:17:54.992 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 10 mgrc shutdown 2026-02-24T18:17:54.992 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 1 -- 10.20.193.52:0/2805975932 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3d8003db20 msgr2=0x7f3d8003ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.992 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 1 --2- 10.20.193.52:0/2805975932 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3d8003db20 0x7f3d8003ffe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3d900099c0 tx=0x7f3d90006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.992 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 1 -- 10.20.193.52:0/2805975932 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 msgr2=0x7f3da819f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:54.992 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 1 --2- 10.20.193.52:0/2805975932 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da819f170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c039040 tx=0x7f3d9c037620 comp rx=0 tx=0).stop 2026-02-24T18:17:54.992 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 1 -- 10.20.193.52:0/2805975932 shutdown_connections 2026-02-24T18:17:54.992 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 1 --2- 10.20.193.52:0/2805975932 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3d8003db20 0x7f3d8003ffe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.992 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 1 --2- 10.20.193.52:0/2805975932 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3da81090d0 0x7f3da819f170 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:54.992 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 1 -- 10.20.193.52:0/2805975932 >> 10.20.193.52:0/2805975932 conn(0x7f3da807ca50 msgr2=0x7f3da8106e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:54.992 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 1 -- 10.20.193.52:0/2805975932 shutdown_connections 2026-02-24T18:17:54.993 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:54.960+0000 7f3dacc05640 1 -- 10.20.193.52:0/2805975932 wait complete. 2026-02-24T18:17:54.993 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T18:17:54.993 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout disabled 2026-02-24T18:17:54.996 INFO:teuthology.orchestra.run.trial052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T18:17:54.996 INFO:teuthology.orchestra.run.trial052.stdout:systemctl: stdout inactive 2026-02-24T18:17:54.996 INFO:teuthology.orchestra.run.trial052.stdout:firewalld.service is not enabled 2026-02-24T18:17:54.996 INFO:teuthology.orchestra.run.trial052.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-24T18:17:54.997 INFO:teuthology.orchestra.run.trial052.stdout:Ceph Dashboard is now available at: 2026-02-24T18:17:54.997 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:54.997 INFO:teuthology.orchestra.run.trial052.stdout: URL: https://trial052:8443/ 2026-02-24T18:17:54.997 INFO:teuthology.orchestra.run.trial052.stdout: User: admin 2026-02-24T18:17:54.997 INFO:teuthology.orchestra.run.trial052.stdout: Password: 9s7r6kk3fq 2026-02-24T18:17:54.997 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:54.998 INFO:teuthology.orchestra.run.trial052.stdout:Saving cluster configuration to /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/config directory 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.090+0000 7fc7d2885640 1 Processor -- start 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.090+0000 7fc7d2885640 1 -- start start 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.090+0000 7fc7d2885640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc110410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.090+0000 7fc7d2885640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc081620 con 0x7fc7cc10e020 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.090+0000 7fc7cbfff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc110410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.090+0000 7fc7cbfff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc110410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:41028/0 (socket says 10.20.193.52:41028) 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.090+0000 7fc7cbfff640 1 -- 10.20.193.52:0/30756759 learned_addr learned my addr 10.20.193.52:0/30756759 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.090+0000 7fc7cbfff640 1 -- 10.20.193.52:0/30756759 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc110950 con 0x7fc7cc10e020 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7cbfff640 1 --2- 10.20.193.52:0/30756759 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc110410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009920 tx=0x7fc7b802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ccfa8193737287 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7caffd640 1 -- 10.20.193.52:0/30756759 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b803c070 con 0x7fc7cc10e020 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7caffd640 1 -- 10.20.193.52:0/30756759 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc7b8037440 con 0x7fc7cc10e020 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7caffd640 1 -- 10.20.193.52:0/30756759 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b80354d0 con 0x7fc7cc10e020 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7d2885640 1 -- 10.20.193.52:0/30756759 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 msgr2=0x7fc7cc110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7d2885640 1 --2- 10.20.193.52:0/30756759 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc110410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009920 tx=0x7fc7b802ef20 comp rx=0 tx=0).stop 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7d2885640 1 -- 10.20.193.52:0/30756759 shutdown_connections 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7d2885640 1 --2- 10.20.193.52:0/30756759 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc110410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7d2885640 1 -- 10.20.193.52:0/30756759 >> 10.20.193.52:0/30756759 conn(0x7fc7cc07c7e0 msgr2=0x7fc7cc07ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:55.244 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7d2885640 1 -- 10.20.193.52:0/30756759 shutdown_connections 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.091+0000 7fc7d2885640 1 -- 10.20.193.52:0/30756759 wait complete. 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7d2885640 1 Processor -- start 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7d2885640 1 -- start start 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7d2885640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc1a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7d2885640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc111860 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7cbfff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc1a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7cbfff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc1a3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:41042/0 (socket says 10.20.193.52:41042) 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7cbfff640 1 -- 10.20.193.52:0/2133357703 learned_addr learned my addr 10.20.193.52:0/2133357703 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7cbfff640 1 -- 10.20.193.52:0/2133357703 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc1a3ba0 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7cbfff640 1 --2- 10.20.193.52:0/2133357703 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc1a3660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8002410 tx=0x7fc7b802fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7c97fa640 1 -- 10.20.193.52:0/2133357703 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8047070 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7c97fa640 1 -- 10.20.193.52:0/2133357703 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc7b8042440 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7d2885640 1 -- 10.20.193.52:0/2133357703 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7cc1a3e30 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7c97fa640 1 -- 10.20.193.52:0/2133357703 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b803c070 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.092+0000 7fc7d2885640 1 -- 10.20.193.52:0/2133357703 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7cc1a6b20 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.093+0000 7fc7c97fa640 1 -- 10.20.193.52:0/2133357703 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 11) ==== 50154+0+0 (secure 0 0 0) 0x7fc7b8035b10 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.093+0000 7fc7c97fa640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.093+0000 7fc7d2885640 1 -- 10.20.193.52:0/2133357703 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7cc10e480 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.093+0000 7fc7c97fa640 4 mgrc handle_mgr_map Got map version 11 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.093+0000 7fc7c97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.093+0000 7fc7c97fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.093+0000 7fc7c97fa640 1 --2- 10.20.193.52:0/2133357703 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc7a003dad0 0x7fc7a003ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.093+0000 7fc7c97fa640 1 -- 10.20.193.52:0/2133357703 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc7b8076ca0 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.093+0000 7fc7cb7fe640 1 --2- 10.20.193.52:0/2133357703 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc7a003dad0 0x7fc7a003ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.093+0000 7fc7cb7fe640 1 --2- 10.20.193.52:0/2133357703 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc7a003dad0 0x7fc7a003ff90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0099c0 tx=0x7fc7bc006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.095+0000 7fc7c97fa640 1 -- 10.20.193.52:0/2133357703 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc7b804a360 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.219+0000 7fc7d2885640 1 -- 10.20.193.52:0/2133357703 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fc7cc19cce0 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.221+0000 7fc7c97fa640 1 -- 10.20.193.52:0/2133357703 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fc7b804f120 con 0x7fc7cc10e020 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 10 mgrc shutdown 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 1 -- 10.20.193.52:0/2133357703 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc7a003dad0 msgr2=0x7fc7a003ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 1 --2- 10.20.193.52:0/2133357703 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc7a003dad0 0x7fc7a003ff90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0099c0 tx=0x7fc7bc006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 1 -- 10.20.193.52:0/2133357703 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 msgr2=0x7fc7cc1a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 1 --2- 10.20.193.52:0/2133357703 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc1a3660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8002410 tx=0x7fc7b802fd20 comp rx=0 tx=0).stop 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 1 -- 10.20.193.52:0/2133357703 shutdown_connections 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 1 --2- 10.20.193.52:0/2133357703 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc7a003dad0 0x7fc7a003ff90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 1 --2- 10.20.193.52:0/2133357703 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc7cc10e020 0x7fc7cc1a3660 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 1 -- 10.20.193.52:0/2133357703 >> 10.20.193.52:0/2133357703 conn(0x7fc7cc07c7e0 msgr2=0x7fc7cc07e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 1 -- 10.20.193.52:0/2133357703 shutdown_connections 2026-02-24T18:17:55.245 INFO:teuthology.orchestra.run.trial052.stdout:/usr/bin/ceph: stderr 2026-02-24T18:17:55.222+0000 7fc7d2885640 1 -- 10.20.193.52:0/2133357703 wait complete. 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout:Or, if you are only running a single cluster on this host: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: ceph telemetry on 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout:For more information see: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:55.246 INFO:teuthology.orchestra.run.trial052.stdout:Bootstrap complete. 2026-02-24T18:17:55.272 INFO:tasks.cephadm:Fetching config... 2026-02-24T18:17:55.273 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:17:55.273 DEBUG:teuthology.orchestra.run.trial052:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-24T18:17:55.292 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-24T18:17:55.292 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:17:55.293 DEBUG:teuthology.orchestra.run.trial052:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-24T18:17:55.349 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-24T18:17:55.350 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:17:55.350 DEBUG:teuthology.orchestra.run.trial052:> sudo dd if=/var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-24T18:17:55.416 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-24T18:17:55.417 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:17:55.417 DEBUG:teuthology.orchestra.run.trial052:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-24T18:17:55.474 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-24T18:17:55.474 DEBUG:teuthology.orchestra.run.trial052:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN7aJuQqpHRUrI16SkJAodS0tKjnaZztF3QZc2MdedYR ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T18:17:55.548 INFO:teuthology.orchestra.run.trial052.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN7aJuQqpHRUrI16SkJAodS0tKjnaZztF3QZc2MdedYR ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:55.559 DEBUG:teuthology.orchestra.run.trial080:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN7aJuQqpHRUrI16SkJAodS0tKjnaZztF3QZc2MdedYR ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T18:17:55.596 INFO:teuthology.orchestra.run.trial080.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN7aJuQqpHRUrI16SkJAodS0tKjnaZztF3QZc2MdedYR ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:17:55.606 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-24T18:17:55.752 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:17:55.799 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:55 trial052 ceph-mon[39446]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:55.800 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:55 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:55.800 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:55 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2805975932' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-24T18:17:55.800 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:55 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2133357703' entity='client.admin' 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.861+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/1159158112 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd2cc1011f0 msgr2=0x7fd2cc1015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.861+0000 7fd2d3fb6640 1 --2- 10.20.193.52:0/1159158112 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd2cc1011f0 0x7fd2cc1015f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0099b0 tx=0x7fd2bc02f2b0 comp rx=0 tx=0).stop 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/1159158112 shutdown_connections 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 --2- 10.20.193.52:0/1159158112 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd2cc1011f0 0x7fd2cc1015f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/1159158112 >> 10.20.193.52:0/1159158112 conn(0x7fd2cc0fc9a0 msgr2=0x7fd2cc0fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/1159158112 shutdown_connections 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/1159158112 wait complete. 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 Processor -- start 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 -- start start 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd2cc1011f0 0x7fd2cc19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc106670 con 0x7fd2cc1011f0 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d1d2b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd2cc1011f0 0x7fd2cc19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d1d2b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd2cc1011f0 0x7fd2cc19b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:41064/0 (socket says 10.20.193.52:41064) 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d1d2b640 1 -- 10.20.193.52:0/341695754 learned_addr learned my addr 10.20.193.52:0/341695754 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:55.865 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d1d2b640 1 -- 10.20.193.52:0/341695754 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc19b6e0 con 0x7fd2cc1011f0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d1d2b640 1 --2- 10.20.193.52:0/341695754 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd2cc1011f0 0x7fd2cc19b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc005ec0 tx=0x7fd2bc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2baffd640 1 -- 10.20.193.52:0/341695754 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2bc038510 con 0x7fd2cc1011f0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2baffd640 1 -- 10.20.193.52:0/341695754 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fd2bc046070 con 0x7fd2cc1011f0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2baffd640 1 -- 10.20.193.52:0/341695754 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2bc041810 con 0x7fd2cc1011f0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/341695754 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2cc19b970 con 0x7fd2cc1011f0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.862+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/341695754 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2cc19e660 con 0x7fd2cc1011f0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.863+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/341695754 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2cc106e10 con 0x7fd2cc1011f0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.863+0000 7fd2baffd640 1 -- 10.20.193.52:0/341695754 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 12) ==== 50260+0+0 (secure 0 0 0) 0x7fd2bc0386b0 con 0x7fd2cc1011f0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.863+0000 7fd2baffd640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.863+0000 7fd2baffd640 4 mgrc handle_mgr_map Got map version 12 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.863+0000 7fd2baffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.863+0000 7fd2baffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.863+0000 7fd2baffd640 1 --2- 10.20.193.52:0/341695754 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd2a803dc40 0x7fd2a8040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.863+0000 7fd2baffd640 1 -- 10.20.193.52:0/341695754 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd2bc077000 con 0x7fd2cc1011f0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.863+0000 7fd2d152a640 1 --2- 10.20.193.52:0/341695754 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd2a803dc40 0x7fd2a8040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:55.866 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.864+0000 7fd2d152a640 1 --2- 10.20.193.52:0/341695754 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd2a803dc40 0x7fd2a8040100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00099c0 tx=0x7fd2c0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:55.868 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.866+0000 7fd2baffd640 1 -- 10.20.193.52:0/341695754 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd2bc050200 con 0x7fd2cc1011f0 2026-02-24T18:17:55.953 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.950+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/341695754 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fd2cc19e940 con 0x7fd2cc1011f0 2026-02-24T18:17:55.954 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.952+0000 7fd2baffd640 1 -- 10.20.193.52:0/341695754 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fd2bc0389d0 con 0x7fd2cc1011f0 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 10 mgrc shutdown 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/341695754 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd2a803dc40 msgr2=0x7fd2a8040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 1 --2- 10.20.193.52:0/341695754 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd2a803dc40 0x7fd2a8040100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00099c0 tx=0x7fd2c0006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/341695754 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd2cc1011f0 msgr2=0x7fd2cc19b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 1 --2- 10.20.193.52:0/341695754 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd2cc1011f0 0x7fd2cc19b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc005ec0 tx=0x7fd2bc004290 comp rx=0 tx=0).stop 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/341695754 shutdown_connections 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 1 --2- 10.20.193.52:0/341695754 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd2a803dc40 0x7fd2a8040100 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 1 --2- 10.20.193.52:0/341695754 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd2cc1011f0 0x7fd2cc19b1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/341695754 >> 10.20.193.52:0/341695754 conn(0x7fd2cc0fc9a0 msgr2=0x7fd2cc0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/341695754 shutdown_connections 2026-02-24T18:17:55.956 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:55.953+0000 7fd2d3fb6640 1 -- 10.20.193.52:0/341695754 wait complete. 2026-02-24T18:17:55.992 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-24T18:17:55.993 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-24T18:17:56.141 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 -- 10.20.193.52:0/1396583024 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc07c1045b0 msgr2=0x7fc07c1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 --2- 10.20.193.52:0/1396583024 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc07c1045b0 0x7fc07c1049b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc0740099b0 tx=0x7fc07402f2b0 comp rx=0 tx=0).stop 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 -- 10.20.193.52:0/1396583024 shutdown_connections 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 --2- 10.20.193.52:0/1396583024 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc07c1045b0 0x7fc07c1049b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 -- 10.20.193.52:0/1396583024 >> 10.20.193.52:0/1396583024 conn(0x7fc07c0ffd70 msgr2=0x7fc07c102180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 -- 10.20.193.52:0/1396583024 shutdown_connections 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 -- 10.20.193.52:0/1396583024 wait complete. 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 Processor -- start 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 -- start start 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc07c1045b0 0x7fc07c19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc08499e640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c109a30 con 0x7fc07c1045b0 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc082713640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc07c1045b0 0x7fc07c19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc082713640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc07c1045b0 0x7fc07c19b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:41086/0 (socket says 10.20.193.52:41086) 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.254+0000 7fc082713640 1 -- 10.20.193.52:0/3290796570 learned_addr learned my addr 10.20.193.52:0/3290796570 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.255+0000 7fc082713640 1 -- 10.20.193.52:0/3290796570 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07c19b720 con 0x7fc07c1045b0 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.255+0000 7fc082713640 1 --2- 10.20.193.52:0/3290796570 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc07c1045b0 0x7fc07c19b1e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc074005ec0 tx=0x7fc074004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.255+0000 7fc0677fe640 1 -- 10.20.193.52:0/3290796570 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074038510 con 0x7fc07c1045b0 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.255+0000 7fc08499e640 1 -- 10.20.193.52:0/3290796570 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07c19b9b0 con 0x7fc07c1045b0 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.255+0000 7fc0677fe640 1 -- 10.20.193.52:0/3290796570 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc074046070 con 0x7fc07c1045b0 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.255+0000 7fc0677fe640 1 -- 10.20.193.52:0/3290796570 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074041810 con 0x7fc07c1045b0 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.255+0000 7fc08499e640 1 -- 10.20.193.52:0/3290796570 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07c19e6a0 con 0x7fc07c1045b0 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.255+0000 7fc08499e640 1 -- 10.20.193.52:0/3290796570 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc07c10a1d0 con 0x7fc07c1045b0 2026-02-24T18:17:56.258 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.255+0000 7fc0677fe640 1 -- 10.20.193.52:0/3290796570 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 12) ==== 50260+0+0 (secure 0 0 0) 0x7fc0740386b0 con 0x7fc07c1045b0 2026-02-24T18:17:56.259 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.255+0000 7fc0677fe640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-24T18:17:56.259 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.256+0000 7fc0677fe640 4 mgrc handle_mgr_map Got map version 12 2026-02-24T18:17:56.259 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.256+0000 7fc0677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:56.259 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.256+0000 7fc0677fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:56.259 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.256+0000 7fc0677fe640 1 --2- 10.20.193.52:0/3290796570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc05803dc40 0x7fc058040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:56.259 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.256+0000 7fc0677fe640 1 -- 10.20.193.52:0/3290796570 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc074077000 con 0x7fc07c1045b0 2026-02-24T18:17:56.259 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.256+0000 7fc081f12640 1 --2- 10.20.193.52:0/3290796570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc05803dc40 0x7fc058040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:56.259 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.256+0000 7fc081f12640 1 --2- 10.20.193.52:0/3290796570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc05803dc40 0x7fc058040100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0680099c0 tx=0x7fc068006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:56.261 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.258+0000 7fc0677fe640 1 -- 10.20.193.52:0/3290796570 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc074050200 con 0x7fc07c1045b0 2026-02-24T18:17:56.346 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.343+0000 7fc08499e640 20 mgrc start_command cmd: [{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}] 2026-02-24T18:17:56.346 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.343+0000 7fc08499e640 1 -- 10.20.193.52:0/3290796570 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fc07c194790 con 0x7fc05803dc40 2026-02-24T18:17:56.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.346+0000 7fc0677fe640 1 -- 10.20.193.52:0/3290796570 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc07c194790 con 0x7fc05803dc40 2026-02-24T18:17:56.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.346+0000 7fc0677fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 10 mgrc shutdown 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 1 -- 10.20.193.52:0/3290796570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc05803dc40 msgr2=0x7fc058040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 1 --2- 10.20.193.52:0/3290796570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc05803dc40 0x7fc058040100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0680099c0 tx=0x7fc068006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 1 -- 10.20.193.52:0/3290796570 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc07c1045b0 msgr2=0x7fc07c19b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 1 --2- 10.20.193.52:0/3290796570 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc07c1045b0 0x7fc07c19b1e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc074005ec0 tx=0x7fc074004290 comp rx=0 tx=0).stop 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 1 -- 10.20.193.52:0/3290796570 shutdown_connections 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 1 --2- 10.20.193.52:0/3290796570 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc05803dc40 0x7fc058040100 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 1 --2- 10.20.193.52:0/3290796570 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc07c1045b0 0x7fc07c19b1e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 1 -- 10.20.193.52:0/3290796570 >> 10.20.193.52:0/3290796570 conn(0x7fc07c0ffd70 msgr2=0x7fc07c100410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 1 -- 10.20.193.52:0/3290796570 shutdown_connections 2026-02-24T18:17:56.350 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.348+0000 7fc08499e640 1 -- 10.20.193.52:0/3290796570 wait complete. 2026-02-24T18:17:56.400 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial080 2026-02-24T18:17:56.400 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:17:56.400 DEBUG:teuthology.orchestra.run.trial080:> dd of=/etc/ceph/ceph.conf 2026-02-24T18:17:56.418 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:17:56.418 DEBUG:teuthology.orchestra.run.trial080:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T18:17:56.473 INFO:tasks.cephadm:Adding host trial080 to orchestrator... 2026-02-24T18:17:56.473 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph orch host add trial080 2026-02-24T18:17:56.620 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 -- 10.20.193.52:0/4187654753 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7740102340 msgr2=0x7f7740102740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 --2- 10.20.193.52:0/4187654753 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7740102340 0x7f7740102740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77300099b0 tx=0x7f773002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 -- 10.20.193.52:0/4187654753 shutdown_connections 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 --2- 10.20.193.52:0/4187654753 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7740102340 0x7f7740102740 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 -- 10.20.193.52:0/4187654753 >> 10.20.193.52:0/4187654753 conn(0x7f77400fdad0 msgr2=0x7f77400fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 -- 10.20.193.52:0/4187654753 shutdown_connections 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 -- 10.20.193.52:0/4187654753 wait complete. 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 Processor -- start 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 -- start start 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7740102340 0x7f7740076d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f77470b0640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77401077c0 con 0x7f7740102340 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f7744e25640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7740102340 0x7f7740076d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f7744e25640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7740102340 0x7f7740076d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:41094/0 (socket says 10.20.193.52:41094) 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.724+0000 7f7744e25640 1 -- 10.20.193.52:0/518187 learned_addr learned my addr 10.20.193.52:0/518187 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:56.727 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.725+0000 7f7744e25640 1 -- 10.20.193.52:0/518187 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7740077270 con 0x7f7740102340 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.725+0000 7f7744e25640 1 --2- 10.20.193.52:0/518187 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7740102340 0x7f7740076d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7730005ec0 tx=0x7f7730004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.725+0000 7f7735ffb640 1 -- 10.20.193.52:0/518187 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7730038510 con 0x7f7740102340 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.725+0000 7f7735ffb640 1 -- 10.20.193.52:0/518187 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7730046070 con 0x7f7740102340 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.725+0000 7f77470b0640 1 -- 10.20.193.52:0/518187 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7740075460 con 0x7f7740102340 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.725+0000 7f7735ffb640 1 -- 10.20.193.52:0/518187 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7730041810 con 0x7f7740102340 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.725+0000 7f77470b0640 1 -- 10.20.193.52:0/518187 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7740075940 con 0x7f7740102340 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.725+0000 7f77470b0640 1 -- 10.20.193.52:0/518187 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7740107f60 con 0x7f7740102340 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.725+0000 7f7735ffb640 1 -- 10.20.193.52:0/518187 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 12) ==== 50260+0+0 (secure 0 0 0) 0x7f77300386b0 con 0x7f7740102340 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.725+0000 7f7735ffb640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.726+0000 7f7735ffb640 4 mgrc handle_mgr_map Got map version 12 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.726+0000 7f7735ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.726+0000 7f7735ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.726+0000 7f7735ffb640 1 --2- 10.20.193.52:0/518187 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f771c03dc40 0x7f771c040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.726+0000 7f7735ffb640 1 -- 10.20.193.52:0/518187 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7730076ff0 con 0x7f7740102340 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.726+0000 7f7737fff640 1 --2- 10.20.193.52:0/518187 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f771c03dc40 0x7f771c040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:56.728 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.726+0000 7f7737fff640 1 --2- 10.20.193.52:0/518187 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f771c03dc40 0x7f771c040100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f77280099c0 tx=0x7f7728006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:56.730 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.728+0000 7f7735ffb640 1 -- 10.20.193.52:0/518187 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f77300389d0 con 0x7f7740102340 2026-02-24T18:17:56.816 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.813+0000 7f77470b0640 20 mgrc start_command cmd: [{"prefix": "orch host add", "hostname": "trial080", "target": ["mon-mgr", ""]}] 2026-02-24T18:17:56.816 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:56.813+0000 7f77470b0640 1 -- 10.20.193.52:0/518187 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial080", "target": ["mon-mgr", ""]}) -- 0x7f77401924b0 con 0x7f771c03dc40 2026-02-24T18:17:56.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: mgrmap e12: a(active, since 2s) 2026-02-24T18:17:56.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:56.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:56.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial052", "name": "osd_memory_target"}]: dispatch 2026-02-24T18:17:56.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:56.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:17:56.967 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:56.967 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/341695754' entity='client.admin' 2026-02-24T18:17:56.967 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:17:56.967 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:56.967 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:56.967 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:56.967 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:17:56.968 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:17:56.968 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-24T18:17:56.968 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: Updating trial052:/etc/ceph/ceph.conf 2026-02-24T18:17:56.968 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:56 trial052 ceph-mon[39446]: Updating trial052:/var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/config/ceph.conf 2026-02-24T18:17:58.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:57 trial052 ceph-mon[39446]: Updating trial052:/etc/ceph/ceph.client.admin.keyring 2026-02-24T18:17:58.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:57 trial052 ceph-mon[39446]: Updating trial052:/var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T18:17:58.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:57 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:58.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:57 trial052 ceph-mon[39446]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial080", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:17:58.216 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:57 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:58.216 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:57 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:58.216 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:57 trial052 ceph-mon[39446]: Deploying cephadm binary to trial080 2026-02-24T18:17:58.302 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.299+0000 7f7735ffb640 1 -- 10.20.193.52:0/518187 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f77401924b0 con 0x7f771c03dc40 2026-02-24T18:17:58.303 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.299+0000 7f7735ffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:58.303 INFO:teuthology.orchestra.run.trial052.stdout:Added host 'trial080' with addr '10.20.193.80' 2026-02-24T18:17:58.304 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 10 mgrc shutdown 2026-02-24T18:17:58.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 1 -- 10.20.193.52:0/518187 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f771c03dc40 msgr2=0x7f771c040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:58.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 1 --2- 10.20.193.52:0/518187 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f771c03dc40 0x7f771c040100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f77280099c0 tx=0x7f7728006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 1 -- 10.20.193.52:0/518187 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7740102340 msgr2=0x7f7740076d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:58.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 1 --2- 10.20.193.52:0/518187 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7740102340 0x7f7740076d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7730005ec0 tx=0x7f7730004290 comp rx=0 tx=0).stop 2026-02-24T18:17:58.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 1 -- 10.20.193.52:0/518187 shutdown_connections 2026-02-24T18:17:58.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 1 --2- 10.20.193.52:0/518187 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f771c03dc40 0x7f771c040100 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 1 --2- 10.20.193.52:0/518187 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7740102340 0x7f7740076d30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 1 -- 10.20.193.52:0/518187 >> 10.20.193.52:0/518187 conn(0x7f77400fdad0 msgr2=0x7f77400fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:58.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 1 -- 10.20.193.52:0/518187 shutdown_connections 2026-02-24T18:17:58.306 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.301+0000 7f77470b0640 1 -- 10.20.193.52:0/518187 wait complete. 2026-02-24T18:17:58.340 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-24T18:17:58.487 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:17:58.590 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 -- 10.20.193.52:0/3043606943 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe1380752a0 msgr2=0x7fe138075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:58.590 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 --2- 10.20.193.52:0/3043606943 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe1380752a0 0x7fe138075680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe1280099b0 tx=0x7fe12802f2b0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.590 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 -- 10.20.193.52:0/3043606943 shutdown_connections 2026-02-24T18:17:58.590 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 --2- 10.20.193.52:0/3043606943 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe1380752a0 0x7fe138075680 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 -- 10.20.193.52:0/3043606943 >> 10.20.193.52:0/3043606943 conn(0x7fe138078090 msgr2=0x7fe1380784a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 -- 10.20.193.52:0/3043606943 shutdown_connections 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 -- 10.20.193.52:0/3043606943 wait complete. 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 Processor -- start 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 -- start start 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe1380752a0 0x7fe13819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13fb84640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe13810dfd0 con 0x7fe1380752a0 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13d8f9640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe1380752a0 0x7fe13819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13d8f9640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe1380752a0 0x7fe13819b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:41120/0 (socket says 10.20.193.52:41120) 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13d8f9640 1 -- 10.20.193.52:0/1574731009 learned_addr learned my addr 10.20.193.52:0/1574731009 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:58.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.585+0000 7fe13d8f9640 1 -- 10.20.193.52:0/1574731009 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13819ba80 con 0x7fe1380752a0 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe13d8f9640 1 --2- 10.20.193.52:0/1574731009 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe1380752a0 0x7fe13819b540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe128004290 tx=0x7fe1280042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe126ffd640 1 -- 10.20.193.52:0/1574731009 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe128038510 con 0x7fe1380752a0 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe126ffd640 1 -- 10.20.193.52:0/1574731009 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe128046070 con 0x7fe1380752a0 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe13fb84640 1 -- 10.20.193.52:0/1574731009 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13819bd10 con 0x7fe1380752a0 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe126ffd640 1 -- 10.20.193.52:0/1574731009 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe128041610 con 0x7fe1380752a0 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe13fb84640 1 -- 10.20.193.52:0/1574731009 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13819fe10 con 0x7fe1380752a0 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe13fb84640 1 -- 10.20.193.52:0/1574731009 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1380767b0 con 0x7fe1380752a0 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe126ffd640 1 -- 10.20.193.52:0/1574731009 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 12) ==== 50260+0+0 (secure 0 0 0) 0x7fe1280386b0 con 0x7fe1380752a0 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe126ffd640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe126ffd640 4 mgrc handle_mgr_map Got map version 12 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe126ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:58.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe126ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:58.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe126ffd640 1 --2- 10.20.193.52:0/1574731009 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe11403dbf0 0x7fe1140400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:58.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe126ffd640 1 -- 10.20.193.52:0/1574731009 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe128076f30 con 0x7fe1380752a0 2026-02-24T18:17:58.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.586+0000 7fe13d0f8640 1 --2- 10.20.193.52:0/1574731009 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe11403dbf0 0x7fe1140400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:58.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.587+0000 7fe13d0f8640 1 --2- 10.20.193.52:0/1574731009 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe11403dbf0 0x7fe1140400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0099c0 tx=0x7fe12c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:58.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.589+0000 7fe126ffd640 1 -- 10.20.193.52:0/1574731009 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe12804ade0 con 0x7fe1380752a0 2026-02-24T18:17:58.680 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.677+0000 7fe13fb84640 20 mgrc start_command cmd: [{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-24T18:17:58.680 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.677+0000 7fe13fb84640 1 -- 10.20.193.52:0/1574731009 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe138075700 con 0x7fe11403dbf0 2026-02-24T18:17:58.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.678+0000 7fe126ffd640 1 -- 10.20.193.52:0/1574731009 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+157 (secure 0 0 0) 0x7fe138075700 con 0x7fe11403dbf0 2026-02-24T18:17:58.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.678+0000 7fe126ffd640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:17:58.681 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:17:58.681 INFO:teuthology.orchestra.run.trial052.stdout:[{"addr": "10.20.193.52", "hostname": "trial052", "labels": [], "status": ""}, {"addr": "10.20.193.80", "hostname": "trial080", "labels": [], "status": ""}] 2026-02-24T18:17:58.682 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.678+0000 7fe13fb84640 10 mgrc shutdown 2026-02-24T18:17:58.682 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.678+0000 7fe13fb84640 1 -- 10.20.193.52:0/1574731009 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe11403dbf0 msgr2=0x7fe1140400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:58.683 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.678+0000 7fe13fb84640 1 --2- 10.20.193.52:0/1574731009 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe11403dbf0 0x7fe1140400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0099c0 tx=0x7fe12c006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.683 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.678+0000 7fe13fb84640 1 -- 10.20.193.52:0/1574731009 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe1380752a0 msgr2=0x7fe13819b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:58.683 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.678+0000 7fe13fb84640 1 --2- 10.20.193.52:0/1574731009 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe1380752a0 0x7fe13819b540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe128004290 tx=0x7fe1280042c0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.683 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.679+0000 7fe13fb84640 1 -- 10.20.193.52:0/1574731009 shutdown_connections 2026-02-24T18:17:58.683 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.679+0000 7fe13fb84640 1 --2- 10.20.193.52:0/1574731009 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe11403dbf0 0x7fe1140400b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.683 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.679+0000 7fe13fb84640 1 --2- 10.20.193.52:0/1574731009 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe1380752a0 0x7fe13819b540 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.683 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.679+0000 7fe13fb84640 1 -- 10.20.193.52:0/1574731009 >> 10.20.193.52:0/1574731009 conn(0x7fe138078090 msgr2=0x7fe13810c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:58.683 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.679+0000 7fe13fb84640 1 -- 10.20.193.52:0/1574731009 shutdown_connections 2026-02-24T18:17:58.683 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.679+0000 7fe13fb84640 1 -- 10.20.193.52:0/1574731009 wait complete. 2026-02-24T18:17:58.717 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-24T18:17:58.717 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd crush tunables default 2026-02-24T18:17:58.862 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:17:58.965 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.960+0000 7f566b5c3640 1 -- 10.20.193.52:0/3730461380 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f566410a620 msgr2=0x7f566410aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:58.965 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.960+0000 7f566b5c3640 1 --2- 10.20.193.52:0/3730461380 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f566410a620 0x7f566410aa00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f56540099b0 tx=0x7f565402f2b0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.965 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.960+0000 7f566b5c3640 1 -- 10.20.193.52:0/3730461380 shutdown_connections 2026-02-24T18:17:58.965 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.960+0000 7f566b5c3640 1 --2- 10.20.193.52:0/3730461380 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f566410a620 0x7f566410aa00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:58.965 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.960+0000 7f566b5c3640 1 -- 10.20.193.52:0/3730461380 >> 10.20.193.52:0/3730461380 conn(0x7f5664100290 msgr2=0x7f56641026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:58.965 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.960+0000 7f566b5c3640 1 -- 10.20.193.52:0/3730461380 shutdown_connections 2026-02-24T18:17:58.965 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.960+0000 7f566b5c3640 1 -- 10.20.193.52:0/3730461380 wait complete. 2026-02-24T18:17:58.965 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f566b5c3640 1 Processor -- start 2026-02-24T18:17:58.965 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f566b5c3640 1 -- start start 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f566b5c3640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f566410a620 0x7f566419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f566b5c3640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f566410dfb0 con 0x7f566410a620 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f5669338640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f566410a620 0x7f566419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f5669338640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f566410a620 0x7f566419b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:41146/0 (socket says 10.20.193.52:41146) 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f5669338640 1 -- 10.20.193.52:0/3134934515 learned_addr learned my addr 10.20.193.52:0/3134934515 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f5669338640 1 -- 10.20.193.52:0/3134934515 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566419bb30 con 0x7f566410a620 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f5669338640 1 --2- 10.20.193.52:0/3134934515 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f566410a620 0x7f566419b5f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5654004290 tx=0x7f56540042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f56527fc640 1 -- 10.20.193.52:0/3134934515 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5654038510 con 0x7f566410a620 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f56527fc640 1 -- 10.20.193.52:0/3134934515 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f5654046070 con 0x7f566410a620 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f566b5c3640 1 -- 10.20.193.52:0/3134934515 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566419bdc0 con 0x7f566410a620 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f56527fc640 1 -- 10.20.193.52:0/3134934515 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5654041610 con 0x7f566410a620 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.961+0000 7f566b5c3640 1 -- 10.20.193.52:0/3134934515 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f566419c220 con 0x7f566410a620 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.962+0000 7f566b5c3640 1 -- 10.20.193.52:0/3134934515 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5664105c90 con 0x7f566410a620 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.962+0000 7f56527fc640 1 -- 10.20.193.52:0/3134934515 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 12) ==== 50260+0+0 (secure 0 0 0) 0x7f56540386b0 con 0x7f566410a620 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.962+0000 7f56527fc640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-24T18:17:58.966 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.962+0000 7f56527fc640 4 mgrc handle_mgr_map Got map version 12 2026-02-24T18:17:58.967 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.962+0000 7f56527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:58.967 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.962+0000 7f56527fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:58.967 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.962+0000 7f56527fc640 1 --2- 10.20.193.52:0/3134934515 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f564003dbf0 0x7f56400400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:17:58.967 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.962+0000 7f56527fc640 1 -- 10.20.193.52:0/3134934515 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5654077080 con 0x7f566410a620 2026-02-24T18:17:58.967 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.962+0000 7f5668b37640 1 --2- 10.20.193.52:0/3134934515 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f564003dbf0 0x7f56400400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:17:58.967 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.962+0000 7f5668b37640 1 --2- 10.20.193.52:0/3134934515 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f564003dbf0 0x7f56400400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f56580099c0 tx=0x7f5658006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:17:58.967 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:58.965+0000 7f56527fc640 1 -- 10.20.193.52:0/3134934515 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5654040360 con 0x7f566410a620 2026-02-24T18:17:59.053 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.050+0000 7f566b5c3640 1 -- 10.20.193.52:0/3134934515 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f566419c950 con 0x7f566410a620 2026-02-24T18:17:59.623 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.619+0000 7f56527fc640 1 -- 10.20.193.52:0/3134934515 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f565404b460 con 0x7f566410a620 2026-02-24T18:17:59.623 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.619+0000 7f56527fc640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:17:59.623 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.620+0000 7f56527fc640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:17:59.624 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.620+0000 7f56527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:17:59.624 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.620+0000 7f56527fc640 1 -- 10.20.193.52:0/3134934515 <== mon.0 v2:10.20.193.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f5654049360 con 0x7f566410a620 2026-02-24T18:17:59.624 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:59 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:59.624 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:59 trial052 ceph-mon[39446]: Added host trial080 2026-02-24T18:17:59.624 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:59 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:17:59.624 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:59 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:59.624 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:59 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:17:59.625 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:17:59 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/3134934515' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-24T18:17:59.625 INFO:teuthology.orchestra.run.trial052.stderr:adjusted tunables profile to default 2026-02-24T18:17:59.626 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 10 mgrc shutdown 2026-02-24T18:17:59.626 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 1 -- 10.20.193.52:0/3134934515 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f564003dbf0 msgr2=0x7f56400400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:59.626 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 1 --2- 10.20.193.52:0/3134934515 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f564003dbf0 0x7f56400400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f56580099c0 tx=0x7f5658006eb0 comp rx=0 tx=0).stop 2026-02-24T18:17:59.627 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 1 -- 10.20.193.52:0/3134934515 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f566410a620 msgr2=0x7f566419b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:17:59.627 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 1 --2- 10.20.193.52:0/3134934515 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f566410a620 0x7f566419b5f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5654004290 tx=0x7f56540042c0 comp rx=0 tx=0).stop 2026-02-24T18:17:59.627 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 1 -- 10.20.193.52:0/3134934515 shutdown_connections 2026-02-24T18:17:59.627 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 1 --2- 10.20.193.52:0/3134934515 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f564003dbf0 0x7f56400400b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:59.627 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 1 --2- 10.20.193.52:0/3134934515 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f566410a620 0x7f566419b5f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:17:59.627 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 1 -- 10.20.193.52:0/3134934515 >> 10.20.193.52:0/3134934515 conn(0x7f5664100290 msgr2=0x7f5664109830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:17:59.627 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 1 -- 10.20.193.52:0/3134934515 shutdown_connections 2026-02-24T18:17:59.627 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:17:59.623+0000 7f566b5c3640 1 -- 10.20.193.52:0/3134934515 wait complete. 2026-02-24T18:17:59.663 INFO:tasks.cephadm:Adding mon.a on trial052 2026-02-24T18:17:59.663 DEBUG:teuthology.orchestra.run.trial080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph orch apply mon '1;trial052:10.20.193.52=a' 2026-02-24T18:17:59.898 INFO:teuthology.orchestra.run.trial080.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T18:17:59.931 INFO:teuthology.orchestra.run.trial080.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T18:18:00.037 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 -- 10.20.193.80:0/2241964112 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa6500770a0 msgr2=0x7fa650075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:00.037 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 --2- 10.20.193.80:0/2241964112 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa6500770a0 0x7fa650075500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6400099b0 tx=0x7fa64002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.037 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 -- 10.20.193.80:0/2241964112 shutdown_connections 2026-02-24T18:18:00.037 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 --2- 10.20.193.80:0/2241964112 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa6500770a0 0x7fa650075500 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.037 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 -- 10.20.193.80:0/2241964112 >> 10.20.193.80:0/2241964112 conn(0x7fa6500fd930 msgr2=0x7fa6500ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:00.037 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 -- 10.20.193.80:0/2241964112 shutdown_connections 2026-02-24T18:18:00.037 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 -- 10.20.193.80:0/2241964112 wait complete. 2026-02-24T18:18:00.037 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 Processor -- start 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 -- start start 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa6500770a0 0x7fa65019af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.032+0000 7fa656e37640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa650109860 con 0x7fa6500770a0 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.033+0000 7fa655e35640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa6500770a0 0x7fa65019af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.033+0000 7fa655e35640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa6500770a0 0x7fa65019af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.80:35418/0 (socket says 10.20.193.80:35418) 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.033+0000 7fa655e35640 1 -- 10.20.193.80:0/1950396857 learned_addr learned my addr 10.20.193.80:0/1950396857 (peer_addr_for_me v2:10.20.193.80:0/0) 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.033+0000 7fa655e35640 1 -- 10.20.193.80:0/1950396857 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65019b4c0 con 0x7fa6500770a0 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.033+0000 7fa655e35640 1 --2- 10.20.193.80:0/1950396857 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa6500770a0 0x7fa65019af80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa640002410 tx=0x7fa640004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.033+0000 7fa63effd640 1 -- 10.20.193.80:0/1950396857 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa640038510 con 0x7fa6500770a0 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.033+0000 7fa656e37640 1 -- 10.20.193.80:0/1950396857 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65019b750 con 0x7fa6500770a0 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.034+0000 7fa656e37640 1 -- 10.20.193.80:0/1950396857 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa65019e440 con 0x7fa6500770a0 2026-02-24T18:18:00.038 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.034+0000 7fa63effd640 1 -- 10.20.193.80:0/1950396857 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa640046070 con 0x7fa6500770a0 2026-02-24T18:18:00.039 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.034+0000 7fa63effd640 1 -- 10.20.193.80:0/1950396857 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa64004b460 con 0x7fa6500770a0 2026-02-24T18:18:00.039 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.034+0000 7fa656e37640 1 -- 10.20.193.80:0/1950396857 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa65010a000 con 0x7fa6500770a0 2026-02-24T18:18:00.040 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.034+0000 7fa63effd640 1 -- 10.20.193.80:0/1950396857 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fa6400386b0 con 0x7fa6500770a0 2026-02-24T18:18:00.040 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.034+0000 7fa63effd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:00.040 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.035+0000 7fa63effd640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:00.040 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.035+0000 7fa63effd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:00.041 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.035+0000 7fa63effd640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:00.041 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.035+0000 7fa63effd640 1 --2- 10.20.193.80:0/1950396857 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa62c03dce0 0x7fa62c0401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:00.041 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.035+0000 7fa63effd640 1 -- 10.20.193.80:0/1950396857 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa6400774f0 con 0x7fa6500770a0 2026-02-24T18:18:00.041 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.035+0000 7fa655634640 1 --2- 10.20.193.80:0/1950396857 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa62c03dce0 0x7fa62c0401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:00.041 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.036+0000 7fa655634640 1 --2- 10.20.193.80:0/1950396857 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa62c03dce0 0x7fa62c0401a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa6440099c0 tx=0x7fa644006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:00.041 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.037+0000 7fa63effd640 1 -- 10.20.193.80:0/1950396857 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa6400389d0 con 0x7fa6500770a0 2026-02-24T18:18:00.128 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.125+0000 7fa656e37640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial052:10.20.193.52=a", "target": ["mon-mgr", ""]}] 2026-02-24T18:18:00.129 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.125+0000 7fa656e37640 1 -- 10.20.193.80:0/1950396857 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "1;trial052:10.20.193.52=a", "target": ["mon-mgr", ""]}) -- 0x7fa6501945c0 con 0x7fa62c03dce0 2026-02-24T18:18:00.133 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.131+0000 7fa63effd640 1 -- 10.20.193.80:0/1950396857 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa6501945c0 con 0x7fa62c03dce0 2026-02-24T18:18:00.134 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.131+0000 7fa63effd640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:18:00.134 INFO:teuthology.orchestra.run.trial080.stdout:Scheduled mon update... 2026-02-24T18:18:00.135 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 10 mgrc shutdown 2026-02-24T18:18:00.135 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 1 -- 10.20.193.80:0/1950396857 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa62c03dce0 msgr2=0x7fa62c0401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:00.135 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 1 --2- 10.20.193.80:0/1950396857 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa62c03dce0 0x7fa62c0401a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa6440099c0 tx=0x7fa644006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.135 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 1 -- 10.20.193.80:0/1950396857 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa6500770a0 msgr2=0x7fa65019af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:00.136 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 1 --2- 10.20.193.80:0/1950396857 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa6500770a0 0x7fa65019af80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa640002410 tx=0x7fa640004290 comp rx=0 tx=0).stop 2026-02-24T18:18:00.136 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 1 -- 10.20.193.80:0/1950396857 shutdown_connections 2026-02-24T18:18:00.136 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 1 --2- 10.20.193.80:0/1950396857 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa62c03dce0 0x7fa62c0401a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.136 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 1 --2- 10.20.193.80:0/1950396857 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa6500770a0 0x7fa65019af80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.136 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 1 -- 10.20.193.80:0/1950396857 >> 10.20.193.80:0/1950396857 conn(0x7fa6500fd930 msgr2=0x7fa6500fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:00.136 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 1 -- 10.20.193.80:0/1950396857 shutdown_connections 2026-02-24T18:18:00.136 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.132+0000 7fa656e37640 1 -- 10.20.193.80:0/1950396857 wait complete. 2026-02-24T18:18:00.189 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-02-24T18:18:00.189 DEBUG:teuthology.orchestra.run.trial080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T18:18:00.332 INFO:teuthology.orchestra.run.trial080.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T18:18:00.360 INFO:teuthology.orchestra.run.trial080.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T18:18:00.498 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/3066961222 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8fbc06b4b0 msgr2=0x7f8fbc107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:00.498 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 --2- 10.20.193.80:0/3066961222 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8fbc06b4b0 0x7f8fbc107390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0099b0 tx=0x7f8fac02f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.498 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/3066961222 shutdown_connections 2026-02-24T18:18:00.498 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 --2- 10.20.193.80:0/3066961222 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8fbc06b4b0 0x7f8fbc107390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.498 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/3066961222 >> 10.20.193.80:0/3066961222 conn(0x7f8fbc0fc9a0 msgr2=0x7f8fbc0fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:00.498 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/3066961222 shutdown_connections 2026-02-24T18:18:00.498 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/3066961222 wait complete. 2026-02-24T18:18:00.499 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 Processor -- start 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 -- start start 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8fbc06b4b0 0x7f8fbc19b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.495+0000 7f8fc2ea3640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc109a20 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.496+0000 7f8fc0c18640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8fbc06b4b0 0x7f8fbc19b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.496+0000 7f8fc0c18640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8fbc06b4b0 0x7f8fbc19b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.80:35436/0 (socket says 10.20.193.80:35436) 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.496+0000 7f8fc0c18640 1 -- 10.20.193.80:0/90552657 learned_addr learned my addr 10.20.193.80:0/90552657 (peer_addr_for_me v2:10.20.193.80:0/0) 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.496+0000 7f8fc0c18640 1 -- 10.20.193.80:0/90552657 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc19b6a0 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.496+0000 7f8fc0c18640 1 --2- 10.20.193.80:0/90552657 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8fbc06b4b0 0x7f8fbc19b160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8fac002410 tx=0x7f8fac004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.496+0000 7f8fb1ffb640 1 -- 10.20.193.80:0/90552657 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fac038510 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.496+0000 7f8fb1ffb640 1 -- 10.20.193.80:0/90552657 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8fac046070 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.496+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/90552657 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc19b930 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.496+0000 7f8fb1ffb640 1 -- 10.20.193.80:0/90552657 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fac041760 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.496+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/90552657 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc19e620 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.500 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.497+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/90552657 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc10a1c0 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.501 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.497+0000 7f8fb1ffb640 1 -- 10.20.193.80:0/90552657 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f8fac0386b0 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.501 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.497+0000 7f8fb1ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:00.501 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.497+0000 7f8fb1ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:00.501 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.497+0000 7f8fb1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:00.501 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.497+0000 7f8fb1ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:00.501 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.497+0000 7f8fb1ffb640 1 --2- 10.20.193.80:0/90552657 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8f9803dce0 0x7f8f980401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:00.501 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.497+0000 7f8fb1ffb640 1 -- 10.20.193.80:0/90552657 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8fac0770a0 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.502 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.498+0000 7f8fb3fff640 1 --2- 10.20.193.80:0/90552657 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8f9803dce0 0x7f8f980401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:00.502 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.498+0000 7f8fb3fff640 1 --2- 10.20.193.80:0/90552657 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8f9803dce0 0x7f8f980401a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40099c0 tx=0x7f8fa4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:00.502 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.500+0000 7f8fb1ffb640 1 -- 10.20.193.80:0/90552657 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8fac007c50 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.621 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.618+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/90552657 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8fbc194780 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.621 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.618+0000 7f8fb1ffb640 1 -- 10.20.193.80:0/90552657 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f8fac037cd0 con 0x7f8fbc06b4b0 2026-02-24T18:18:00.621 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:00.621 INFO:teuthology.orchestra.run.trial080.stdout:{"epoch":1,"fsid":"08cedbc6-11ad-11f1-a33f-d404e6e7d460","modified":"2026-02-24T18:17:33.409612Z","created":"2026-02-24T18:17:33.409612Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:3300","nonce":0},{"type":"v1","addr":"10.20.193.52:6789","nonce":0}]},"addr":"10.20.193.52:6789/0","public_addr":"10.20.193.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-24T18:18:00.623 INFO:teuthology.orchestra.run.trial080.stderr:dumped monmap epoch 1 2026-02-24T18:18:00.623 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 10 mgrc shutdown 2026-02-24T18:18:00.623 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/90552657 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8f9803dce0 msgr2=0x7f8f980401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:00.624 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 1 --2- 10.20.193.80:0/90552657 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8f9803dce0 0x7f8f980401a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40099c0 tx=0x7f8fa4006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.624 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/90552657 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8fbc06b4b0 msgr2=0x7f8fbc19b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:00.624 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 1 --2- 10.20.193.80:0/90552657 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8fbc06b4b0 0x7f8fbc19b160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8fac002410 tx=0x7f8fac004290 comp rx=0 tx=0).stop 2026-02-24T18:18:00.624 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/90552657 shutdown_connections 2026-02-24T18:18:00.624 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 1 --2- 10.20.193.80:0/90552657 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8f9803dce0 0x7f8f980401a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.624 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 1 --2- 10.20.193.80:0/90552657 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8fbc06b4b0 0x7f8fbc19b160 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.624 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/90552657 >> 10.20.193.80:0/90552657 conn(0x7f8fbc0fc9a0 msgr2=0x7f8fbc0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:00.624 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/90552657 shutdown_connections 2026-02-24T18:18:00.624 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:00.620+0000 7f8fc2ea3640 1 -- 10.20.193.80:0/90552657 wait complete. 2026-02-24T18:18:00.659 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-24T18:18:00.659 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-24T18:18:00.807 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:00.828 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: mgrmap e13: a(active, since 6s) 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/3134934515' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial080", "name": "osd_memory_target"}]: dispatch 2026-02-24T18:18:00.829 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:00.830 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:00 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-24T18:18:00.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.912+0000 7f7878deb640 1 -- 10.20.193.52:0/3109717235 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f78741027b0 msgr2=0x7f7874102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:00.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.912+0000 7f7878deb640 1 --2- 10.20.193.52:0/3109717235 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f78741027b0 0x7f7874102b90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78680099b0 tx=0x7f786802f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.912+0000 7f7878deb640 1 -- 10.20.193.52:0/3109717235 shutdown_connections 2026-02-24T18:18:00.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.912+0000 7f7878deb640 1 --2- 10.20.193.52:0/3109717235 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f78741027b0 0x7f7874102b90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:00.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.912+0000 7f7878deb640 1 -- 10.20.193.52:0/3109717235 >> 10.20.193.52:0/3109717235 conn(0x7f7874078050 msgr2=0x7f7874078460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:00.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.912+0000 7f7878deb640 1 -- 10.20.193.52:0/3109717235 shutdown_connections 2026-02-24T18:18:00.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.912+0000 7f7878deb640 1 -- 10.20.193.52:0/3109717235 wait complete. 2026-02-24T18:18:00.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7878deb640 1 Processor -- start 2026-02-24T18:18:00.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7878deb640 1 -- start start 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7878deb640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f78741027b0 0x7f7874199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7878deb640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f787410bcc0 con 0x7f78741027b0 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7872575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f78741027b0 0x7f7874199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7872575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f78741027b0 0x7f7874199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:41162/0 (socket says 10.20.193.52:41162) 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7872575640 1 -- 10.20.193.52:0/1667332542 learned_addr learned my addr 10.20.193.52:0/1667332542 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7872575640 1 -- 10.20.193.52:0/1667332542 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78741997c0 con 0x7f78741027b0 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7872575640 1 --2- 10.20.193.52:0/1667332542 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f78741027b0 0x7f7874199280 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7868004290 tx=0x7f78680042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f785b7fe640 1 -- 10.20.193.52:0/1667332542 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7868038510 con 0x7f78741027b0 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f785b7fe640 1 -- 10.20.193.52:0/1667332542 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7868046070 con 0x7f78741027b0 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7878deb640 1 -- 10.20.193.52:0/1667332542 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7874199a50 con 0x7f78741027b0 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f785b7fe640 1 -- 10.20.193.52:0/1667332542 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7868041610 con 0x7f78741027b0 2026-02-24T18:18:00.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.913+0000 7f7878deb640 1 -- 10.20.193.52:0/1667332542 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787419db50 con 0x7f78741027b0 2026-02-24T18:18:00.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.914+0000 7f7878deb640 1 -- 10.20.193.52:0/1667332542 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7874103a10 con 0x7f78741027b0 2026-02-24T18:18:00.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.914+0000 7f785b7fe640 1 -- 10.20.193.52:0/1667332542 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f78680386b0 con 0x7f78741027b0 2026-02-24T18:18:00.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.914+0000 7f785b7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:00.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.914+0000 7f785b7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:00.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.914+0000 7f785b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:00.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.914+0000 7f785b7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:00.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.914+0000 7f785b7fe640 1 --2- 10.20.193.52:0/1667332542 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f784c03dce0 0x7f784c0401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:00.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.914+0000 7f785b7fe640 1 -- 10.20.193.52:0/1667332542 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7868077040 con 0x7f78741027b0 2026-02-24T18:18:00.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.914+0000 7f7871d74640 1 --2- 10.20.193.52:0/1667332542 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f784c03dce0 0x7f784c0401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:00.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.915+0000 7f7871d74640 1 --2- 10.20.193.52:0/1667332542 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f784c03dce0 0x7f784c0401a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f785c0099c0 tx=0x7f785c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:00.919 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:00.917+0000 7f785b7fe640 1 -- 10.20.193.52:0/1667332542 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7868040360 con 0x7f78741027b0 2026-02-24T18:18:01.005 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.002+0000 7f7878deb640 1 -- 10.20.193.52:0/1667332542 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f7874102c10 con 0x7f78741027b0 2026-02-24T18:18:01.005 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.002+0000 7f785b7fe640 1 -- 10.20.193.52:0/1667332542 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+175 (secure 0 0 0) 0x7f7868049360 con 0x7f78741027b0 2026-02-24T18:18:01.006 INFO:teuthology.orchestra.run.trial052.stdout:# minimal ceph.conf for 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:18:01.006 INFO:teuthology.orchestra.run.trial052.stdout:[global] 2026-02-24T18:18:01.006 INFO:teuthology.orchestra.run.trial052.stdout: fsid = 08cedbc6-11ad-11f1-a33f-d404e6e7d460 2026-02-24T18:18:01.006 INFO:teuthology.orchestra.run.trial052.stdout: mon_host = [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] 2026-02-24T18:18:01.007 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 10 mgrc shutdown 2026-02-24T18:18:01.008 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 1 -- 10.20.193.52:0/1667332542 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f784c03dce0 msgr2=0x7f784c0401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:01.008 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 1 --2- 10.20.193.52:0/1667332542 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f784c03dce0 0x7f784c0401a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f785c0099c0 tx=0x7f785c006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:01.008 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 1 -- 10.20.193.52:0/1667332542 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f78741027b0 msgr2=0x7f7874199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:01.008 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 1 --2- 10.20.193.52:0/1667332542 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f78741027b0 0x7f7874199280 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7868004290 tx=0x7f78680042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:01.008 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 1 -- 10.20.193.52:0/1667332542 shutdown_connections 2026-02-24T18:18:01.008 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 1 --2- 10.20.193.52:0/1667332542 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f784c03dce0 0x7f784c0401a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:01.008 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 1 --2- 10.20.193.52:0/1667332542 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f78741027b0 0x7f7874199280 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:01.008 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 1 -- 10.20.193.52:0/1667332542 >> 10.20.193.52:0/1667332542 conn(0x7f7874078050 msgr2=0x7f7874101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:01.008 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 1 -- 10.20.193.52:0/1667332542 shutdown_connections 2026-02-24T18:18:01.009 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:01.004+0000 7f7878deb640 1 -- 10.20.193.52:0/1667332542 wait complete. 2026-02-24T18:18:01.074 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-24T18:18:01.074 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:18:01.074 DEBUG:teuthology.orchestra.run.trial052:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T18:18:01.101 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:18:01.101 DEBUG:teuthology.orchestra.run.trial052:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T18:18:01.167 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:18:01.167 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T18:18:01.195 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:18:01.195 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T18:18:01.259 INFO:tasks.cephadm:Adding mgr.a on trial052 2026-02-24T18:18:01.259 DEBUG:teuthology.orchestra.run.trial080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph orch apply mgr '1;trial052=a' 2026-02-24T18:18:01.437 INFO:teuthology.orchestra.run.trial080.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/config/ceph.conf 2026-02-24T18:18:01.544 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.541+0000 7f8238710640 1 -- 10.20.193.80:0/633730743 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f82301045b0 msgr2=0x7f82301049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:01.544 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.541+0000 7f8238710640 1 --2- 10.20.193.80:0/633730743 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f82301045b0 0x7f82301049b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82200099b0 tx=0x7f822002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:01.545 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.541+0000 7f8238710640 1 -- 10.20.193.80:0/633730743 shutdown_connections 2026-02-24T18:18:01.545 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.541+0000 7f8238710640 1 --2- 10.20.193.80:0/633730743 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f82301045b0 0x7f82301049b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:01.545 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.541+0000 7f8238710640 1 -- 10.20.193.80:0/633730743 >> 10.20.193.80:0/633730743 conn(0x7f82300ffd70 msgr2=0x7f8230102180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:01.545 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.541+0000 7f8238710640 1 -- 10.20.193.80:0/633730743 shutdown_connections 2026-02-24T18:18:01.545 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.541+0000 7f8238710640 1 -- 10.20.193.80:0/633730743 wait complete. 2026-02-24T18:18:01.545 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.541+0000 7f8238710640 1 Processor -- start 2026-02-24T18:18:01.545 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.541+0000 7f8238710640 1 -- start start 2026-02-24T18:18:01.545 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.542+0000 7f8238710640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f82301045b0 0x7f823019b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:01.545 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.542+0000 7f8238710640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8230109a30 con 0x7f82301045b0 2026-02-24T18:18:01.546 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.542+0000 7f8236485640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f82301045b0 0x7f823019b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:01.546 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.542+0000 7f8236485640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f82301045b0 0x7f823019b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.80:35452/0 (socket says 10.20.193.80:35452) 2026-02-24T18:18:01.546 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.542+0000 7f8236485640 1 -- 10.20.193.80:0/1060443485 learned_addr learned my addr 10.20.193.80:0/1060443485 (peer_addr_for_me v2:10.20.193.80:0/0) 2026-02-24T18:18:01.546 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.542+0000 7f8236485640 1 -- 10.20.193.80:0/1060443485 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823019b6d0 con 0x7f82301045b0 2026-02-24T18:18:01.546 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.543+0000 7f8236485640 1 --2- 10.20.193.80:0/1060443485 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f82301045b0 0x7f823019b190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8220002410 tx=0x7f8220004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:01.546 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.543+0000 7f82177fe640 1 -- 10.20.193.80:0/1060443485 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8220038510 con 0x7f82301045b0 2026-02-24T18:18:01.546 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.543+0000 7f8238710640 1 -- 10.20.193.80:0/1060443485 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823019b960 con 0x7f82301045b0 2026-02-24T18:18:01.546 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.543+0000 7f8238710640 1 -- 10.20.193.80:0/1060443485 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823019e650 con 0x7f82301045b0 2026-02-24T18:18:01.546 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.543+0000 7f82177fe640 1 -- 10.20.193.80:0/1060443485 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8220046070 con 0x7f82301045b0 2026-02-24T18:18:01.546 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.543+0000 7f82177fe640 1 -- 10.20.193.80:0/1060443485 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822004b460 con 0x7f82301045b0 2026-02-24T18:18:01.547 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.544+0000 7f8238710640 1 -- 10.20.193.80:0/1060443485 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823010a1d0 con 0x7f82301045b0 2026-02-24T18:18:01.548 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.544+0000 7f82177fe640 1 -- 10.20.193.80:0/1060443485 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f82200386b0 con 0x7f82301045b0 2026-02-24T18:18:01.548 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.544+0000 7f82177fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:01.548 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.544+0000 7f82177fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:01.548 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.544+0000 7f82177fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:01.548 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.544+0000 7f82177fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:01.548 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.544+0000 7f82177fe640 1 --2- 10.20.193.80:0/1060443485 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f820c03dce0 0x7f820c0401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:01.548 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.544+0000 7f82177fe640 1 -- 10.20.193.80:0/1060443485 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8220077040 con 0x7f82301045b0 2026-02-24T18:18:01.548 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.544+0000 7f8235c84640 1 --2- 10.20.193.80:0/1060443485 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f820c03dce0 0x7f820c0401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:01.549 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.545+0000 7f8235c84640 1 --2- 10.20.193.80:0/1060443485 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f820c03dce0 0x7f820c0401a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f82240099c0 tx=0x7f8224006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:01.549 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.546+0000 7f82177fe640 1 -- 10.20.193.80:0/1060443485 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8220035de0 con 0x7f82301045b0 2026-02-24T18:18:01.640 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.637+0000 7f8238710640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial052=a", "target": ["mon-mgr", ""]}] 2026-02-24T18:18:01.641 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.637+0000 7f8238710640 1 -- 10.20.193.80:0/1060443485 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial052=a", "target": ["mon-mgr", ""]}) -- 0x7f8230194800 con 0x7f820c03dce0 2026-02-24T18:18:01.644 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.641+0000 7f82177fe640 1 -- 10.20.193.80:0/1060443485 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8230194800 con 0x7f820c03dce0 2026-02-24T18:18:01.644 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.641+0000 7f82177fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:18:01.644 INFO:teuthology.orchestra.run.trial080.stdout:Scheduled mgr update... 2026-02-24T18:18:01.645 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 10 mgrc shutdown 2026-02-24T18:18:01.646 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 1 -- 10.20.193.80:0/1060443485 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f820c03dce0 msgr2=0x7f820c0401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:01.646 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 1 --2- 10.20.193.80:0/1060443485 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f820c03dce0 0x7f820c0401a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f82240099c0 tx=0x7f8224006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:01.646 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 1 -- 10.20.193.80:0/1060443485 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f82301045b0 msgr2=0x7f823019b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:01.646 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 1 --2- 10.20.193.80:0/1060443485 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f82301045b0 0x7f823019b190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8220002410 tx=0x7f8220004290 comp rx=0 tx=0).stop 2026-02-24T18:18:01.646 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 1 -- 10.20.193.80:0/1060443485 shutdown_connections 2026-02-24T18:18:01.646 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 1 --2- 10.20.193.80:0/1060443485 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f820c03dce0 0x7f820c0401a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:01.646 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 1 --2- 10.20.193.80:0/1060443485 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f82301045b0 0x7f823019b190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:01.646 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 1 -- 10.20.193.80:0/1060443485 >> 10.20.193.80:0/1060443485 conn(0x7f82300ffd70 msgr2=0x7f82301003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:01.647 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 1 -- 10.20.193.80:0/1060443485 shutdown_connections 2026-02-24T18:18:01.647 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:01.642+0000 7f8238710640 1 -- 10.20.193.80:0/1060443485 wait complete. 2026-02-24T18:18:01.681 INFO:tasks.cephadm:Deploying OSDs... 2026-02-24T18:18:01.681 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:18:01.681 DEBUG:teuthology.orchestra.run.trial052:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T18:18:01.698 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T18:18:01.698 DEBUG:teuthology.orchestra.run.trial052:> stat /dev/vg_nvme/lv_1 2026-02-24T18:18:01.755 INFO:teuthology.orchestra.run.trial052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T18:18:01.755 INFO:teuthology.orchestra.run.trial052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:01.755 INFO:teuthology.orchestra.run.trial052.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-24T18:18:01.755 INFO:teuthology.orchestra.run.trial052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:01.755 INFO:teuthology.orchestra.run.trial052.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:01.755 INFO:teuthology.orchestra.run.trial052.stdout:Access: 2026-02-24 18:17:56.146725829 +0000 2026-02-24T18:18:01.755 INFO:teuthology.orchestra.run.trial052.stdout:Modify: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:01.755 INFO:teuthology.orchestra.run.trial052.stdout:Change: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:01.755 INFO:teuthology.orchestra.run.trial052.stdout: Birth: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:01.755 DEBUG:teuthology.orchestra.run.trial052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T18:18:01.814 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial052:10.20.193.52=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:18:01.814 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: Saving service mon spec with placement trial052:10.20.193.52=a;count:1 2026-02-24T18:18:01.814 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: Updating trial080:/etc/ceph/ceph.conf 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: Updating trial080:/var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/config/ceph.conf 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='client.? 10.20.193.80:0/90552657' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1667332542' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-24T18:18:01.815 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:01 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:01.816 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records in 2026-02-24T18:18:01.816 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records out 2026-02-24T18:18:01.816 INFO:teuthology.orchestra.run.trial052.stderr:512 bytes copied, 0.00015165 s, 3.4 MB/s 2026-02-24T18:18:01.817 DEBUG:teuthology.orchestra.run.trial052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T18:18:01.877 DEBUG:teuthology.orchestra.run.trial052:> stat /dev/vg_nvme/lv_2 2026-02-24T18:18:01.934 INFO:teuthology.orchestra.run.trial052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T18:18:01.934 INFO:teuthology.orchestra.run.trial052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:01.934 INFO:teuthology.orchestra.run.trial052.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-24T18:18:01.934 INFO:teuthology.orchestra.run.trial052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:01.935 INFO:teuthology.orchestra.run.trial052.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:01.935 INFO:teuthology.orchestra.run.trial052.stdout:Access: 2026-02-24 18:17:56.146725829 +0000 2026-02-24T18:18:01.935 INFO:teuthology.orchestra.run.trial052.stdout:Modify: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:01.935 INFO:teuthology.orchestra.run.trial052.stdout:Change: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:01.935 INFO:teuthology.orchestra.run.trial052.stdout: Birth: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:01.935 DEBUG:teuthology.orchestra.run.trial052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T18:18:01.998 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records in 2026-02-24T18:18:01.998 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records out 2026-02-24T18:18:01.998 INFO:teuthology.orchestra.run.trial052.stderr:512 bytes copied, 0.000152292 s, 3.4 MB/s 2026-02-24T18:18:01.999 DEBUG:teuthology.orchestra.run.trial052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T18:18:02.057 DEBUG:teuthology.orchestra.run.trial052:> stat /dev/vg_nvme/lv_3 2026-02-24T18:18:02.114 INFO:teuthology.orchestra.run.trial052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T18:18:02.114 INFO:teuthology.orchestra.run.trial052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:02.114 INFO:teuthology.orchestra.run.trial052.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-24T18:18:02.114 INFO:teuthology.orchestra.run.trial052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:02.114 INFO:teuthology.orchestra.run.trial052.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:02.114 INFO:teuthology.orchestra.run.trial052.stdout:Access: 2026-02-24 18:17:56.146725829 +0000 2026-02-24T18:18:02.114 INFO:teuthology.orchestra.run.trial052.stdout:Modify: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:02.114 INFO:teuthology.orchestra.run.trial052.stdout:Change: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:02.114 INFO:teuthology.orchestra.run.trial052.stdout: Birth: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:02.114 DEBUG:teuthology.orchestra.run.trial052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T18:18:02.177 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records in 2026-02-24T18:18:02.177 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records out 2026-02-24T18:18:02.177 INFO:teuthology.orchestra.run.trial052.stderr:512 bytes copied, 0.000160738 s, 3.2 MB/s 2026-02-24T18:18:02.179 DEBUG:teuthology.orchestra.run.trial052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T18:18:02.237 DEBUG:teuthology.orchestra.run.trial052:> stat /dev/vg_nvme/lv_4 2026-02-24T18:18:02.307 INFO:teuthology.orchestra.run.trial052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T18:18:02.307 INFO:teuthology.orchestra.run.trial052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:02.308 INFO:teuthology.orchestra.run.trial052.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-24T18:18:02.308 INFO:teuthology.orchestra.run.trial052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:02.308 INFO:teuthology.orchestra.run.trial052.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:02.308 INFO:teuthology.orchestra.run.trial052.stdout:Access: 2026-02-24 18:17:56.146725829 +0000 2026-02-24T18:18:02.308 INFO:teuthology.orchestra.run.trial052.stdout:Modify: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:02.308 INFO:teuthology.orchestra.run.trial052.stdout:Change: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:02.308 INFO:teuthology.orchestra.run.trial052.stdout: Birth: 2026-02-24 18:16:07.291498725 +0000 2026-02-24T18:18:02.308 DEBUG:teuthology.orchestra.run.trial052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T18:18:02.385 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records in 2026-02-24T18:18:02.386 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records out 2026-02-24T18:18:02.386 INFO:teuthology.orchestra.run.trial052.stderr:512 bytes copied, 0.000143425 s, 3.6 MB/s 2026-02-24T18:18:02.387 DEBUG:teuthology.orchestra.run.trial052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T18:18:02.444 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:18:02.445 DEBUG:teuthology.orchestra.run.trial080:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T18:18:02.463 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T18:18:02.463 DEBUG:teuthology.orchestra.run.trial080:> stat /dev/vg_nvme/lv_1 2026-02-24T18:18:02.519 INFO:teuthology.orchestra.run.trial080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T18:18:02.519 INFO:teuthology.orchestra.run.trial080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:02.519 INFO:teuthology.orchestra.run.trial080.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-24T18:18:02.519 INFO:teuthology.orchestra.run.trial080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:02.520 INFO:teuthology.orchestra.run.trial080.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:02.520 INFO:teuthology.orchestra.run.trial080.stdout:Access: 2026-02-24 18:18:00.126506964 +0000 2026-02-24T18:18:02.520 INFO:teuthology.orchestra.run.trial080.stdout:Modify: 2026-02-24 18:16:06.975830763 +0000 2026-02-24T18:18:02.520 INFO:teuthology.orchestra.run.trial080.stdout:Change: 2026-02-24 18:16:06.975830763 +0000 2026-02-24T18:18:02.520 INFO:teuthology.orchestra.run.trial080.stdout: Birth: 2026-02-24 18:16:06.975830763 +0000 2026-02-24T18:18:02.520 DEBUG:teuthology.orchestra.run.trial080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T18:18:02.583 INFO:teuthology.orchestra.run.trial080.stderr:1+0 records in 2026-02-24T18:18:02.583 INFO:teuthology.orchestra.run.trial080.stderr:1+0 records out 2026-02-24T18:18:02.583 INFO:teuthology.orchestra.run.trial080.stderr:512 bytes copied, 0.00014917 s, 3.4 MB/s 2026-02-24T18:18:02.584 DEBUG:teuthology.orchestra.run.trial080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T18:18:02.642 DEBUG:teuthology.orchestra.run.trial080:> stat /dev/vg_nvme/lv_2 2026-02-24T18:18:02.698 INFO:teuthology.orchestra.run.trial080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T18:18:02.698 INFO:teuthology.orchestra.run.trial080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:02.698 INFO:teuthology.orchestra.run.trial080.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-24T18:18:02.698 INFO:teuthology.orchestra.run.trial080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:02.698 INFO:teuthology.orchestra.run.trial080.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:02.698 INFO:teuthology.orchestra.run.trial080.stdout:Access: 2026-02-24 18:18:00.126506964 +0000 2026-02-24T18:18:02.698 INFO:teuthology.orchestra.run.trial080.stdout:Modify: 2026-02-24 18:16:06.974830771 +0000 2026-02-24T18:18:02.698 INFO:teuthology.orchestra.run.trial080.stdout:Change: 2026-02-24 18:16:06.974830771 +0000 2026-02-24T18:18:02.698 INFO:teuthology.orchestra.run.trial080.stdout: Birth: 2026-02-24 18:16:06.974830771 +0000 2026-02-24T18:18:02.699 DEBUG:teuthology.orchestra.run.trial080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T18:18:02.761 INFO:teuthology.orchestra.run.trial080.stderr:1+0 records in 2026-02-24T18:18:02.762 INFO:teuthology.orchestra.run.trial080.stderr:1+0 records out 2026-02-24T18:18:02.762 INFO:teuthology.orchestra.run.trial080.stderr:512 bytes copied, 0.00018697 s, 2.7 MB/s 2026-02-24T18:18:02.763 DEBUG:teuthology.orchestra.run.trial080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T18:18:02.821 DEBUG:teuthology.orchestra.run.trial080:> stat /dev/vg_nvme/lv_3 2026-02-24T18:18:02.878 INFO:teuthology.orchestra.run.trial080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T18:18:02.878 INFO:teuthology.orchestra.run.trial080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:02.878 INFO:teuthology.orchestra.run.trial080.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-24T18:18:02.878 INFO:teuthology.orchestra.run.trial080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:02.878 INFO:teuthology.orchestra.run.trial080.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:02.878 INFO:teuthology.orchestra.run.trial080.stdout:Access: 2026-02-24 18:18:00.126506964 +0000 2026-02-24T18:18:02.878 INFO:teuthology.orchestra.run.trial080.stdout:Modify: 2026-02-24 18:16:06.974830771 +0000 2026-02-24T18:18:02.879 INFO:teuthology.orchestra.run.trial080.stdout:Change: 2026-02-24 18:16:06.974830771 +0000 2026-02-24T18:18:02.879 INFO:teuthology.orchestra.run.trial080.stdout: Birth: 2026-02-24 18:16:06.974830771 +0000 2026-02-24T18:18:02.879 DEBUG:teuthology.orchestra.run.trial080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T18:18:02.940 INFO:teuthology.orchestra.run.trial080.stderr:1+0 records in 2026-02-24T18:18:02.941 INFO:teuthology.orchestra.run.trial080.stderr:1+0 records out 2026-02-24T18:18:02.941 INFO:teuthology.orchestra.run.trial080.stderr:512 bytes copied, 0.000158376 s, 3.2 MB/s 2026-02-24T18:18:02.942 DEBUG:teuthology.orchestra.run.trial080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T18:18:02.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: Updating trial080:/etc/ceph/ceph.client.admin.keyring 2026-02-24T18:18:02.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: Updating trial080:/var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T18:18:02.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: Reconfiguring mon.a (unknown last config time)... 2026-02-24T18:18:02.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: Reconfiguring daemon mon.a on trial052 2026-02-24T18:18:02.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:02.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:18:02.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:02.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-24T18:18:02.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:02.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:02.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-24T18:18:02.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-24T18:18:02.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:02.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:02.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:02 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:03.001 DEBUG:teuthology.orchestra.run.trial080:> stat /dev/vg_nvme/lv_4 2026-02-24T18:18:03.057 INFO:teuthology.orchestra.run.trial080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T18:18:03.057 INFO:teuthology.orchestra.run.trial080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:03.057 INFO:teuthology.orchestra.run.trial080.stdout:Device: 6h/6d Inode: 1285 Links: 1 2026-02-24T18:18:03.057 INFO:teuthology.orchestra.run.trial080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:03.058 INFO:teuthology.orchestra.run.trial080.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:03.058 INFO:teuthology.orchestra.run.trial080.stdout:Access: 2026-02-24 18:18:00.126506964 +0000 2026-02-24T18:18:03.058 INFO:teuthology.orchestra.run.trial080.stdout:Modify: 2026-02-24 18:16:06.973830779 +0000 2026-02-24T18:18:03.058 INFO:teuthology.orchestra.run.trial080.stdout:Change: 2026-02-24 18:16:06.973830779 +0000 2026-02-24T18:18:03.058 INFO:teuthology.orchestra.run.trial080.stdout: Birth: 2026-02-24 18:16:06.973830779 +0000 2026-02-24T18:18:03.058 DEBUG:teuthology.orchestra.run.trial080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T18:18:03.120 INFO:teuthology.orchestra.run.trial080.stderr:1+0 records in 2026-02-24T18:18:03.120 INFO:teuthology.orchestra.run.trial080.stderr:1+0 records out 2026-02-24T18:18:03.120 INFO:teuthology.orchestra.run.trial080.stderr:512 bytes copied, 0.000145162 s, 3.5 MB/s 2026-02-24T18:18:03.121 DEBUG:teuthology.orchestra.run.trial080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T18:18:03.179 INFO:tasks.cephadm:Deploying osd.0 on trial052 with /dev/vg_nvme/lv_4... 2026-02-24T18:18:03.179 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T18:18:03.320 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:03.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:03 trial052 ceph-mon[39446]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial052=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:18:03.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:03 trial052 ceph-mon[39446]: Saving service mgr spec with placement trial052=a;count:1 2026-02-24T18:18:03.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:03 trial052 ceph-mon[39446]: Reconfiguring mgr.a (unknown last config time)... 2026-02-24T18:18:03.966 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:03 trial052 ceph-mon[39446]: Reconfiguring daemon mgr.a on trial052 2026-02-24T18:18:04.049 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:04.064 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph orch daemon add osd trial052:vg_nvme/lv_4 2026-02-24T18:18:04.211 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:04.314 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 -- 10.20.193.52:0/314910149 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe6401046a0 msgr2=0x7fe640104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:04.315 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 --2- 10.20.193.52:0/314910149 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe6401046a0 0x7fe640104aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0099b0 tx=0x7fe62c02f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:04.315 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 -- 10.20.193.52:0/314910149 shutdown_connections 2026-02-24T18:18:04.315 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 --2- 10.20.193.52:0/314910149 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe6401046a0 0x7fe640104aa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:04.315 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 -- 10.20.193.52:0/314910149 >> 10.20.193.52:0/314910149 conn(0x7fe6400ffe30 msgr2=0x7fe640102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:04.315 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 -- 10.20.193.52:0/314910149 shutdown_connections 2026-02-24T18:18:04.315 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 -- 10.20.193.52:0/314910149 wait complete. 2026-02-24T18:18:04.315 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 Processor -- start 2026-02-24T18:18:04.315 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 -- start start 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe6401046a0 0x7fe64019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe64628f640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe640109b20 con 0x7fe6401046a0 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe63ffff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe6401046a0 0x7fe64019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe63ffff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe6401046a0 0x7fe64019b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:41174/0 (socket says 10.20.193.52:41174) 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe63ffff640 1 -- 10.20.193.52:0/1711937511 learned_addr learned my addr 10.20.193.52:0/1711937511 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe63ffff640 1 -- 10.20.193.52:0/1711937511 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64019b800 con 0x7fe6401046a0 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe63ffff640 1 --2- 10.20.193.52:0/1711937511 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe6401046a0 0x7fe64019b2c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe62c005ec0 tx=0x7fe62c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.310+0000 7fe63d7fa640 1 -- 10.20.193.52:0/1711937511 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe62c038510 con 0x7fe6401046a0 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe63d7fa640 1 -- 10.20.193.52:0/1711937511 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe62c046070 con 0x7fe6401046a0 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe64628f640 1 -- 10.20.193.52:0/1711937511 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64019ba90 con 0x7fe6401046a0 2026-02-24T18:18:04.316 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe63d7fa640 1 -- 10.20.193.52:0/1711937511 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe62c041810 con 0x7fe6401046a0 2026-02-24T18:18:04.317 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe64628f640 1 -- 10.20.193.52:0/1711937511 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe64019e780 con 0x7fe6401046a0 2026-02-24T18:18:04.317 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe64628f640 1 -- 10.20.193.52:0/1711937511 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64010a2c0 con 0x7fe6401046a0 2026-02-24T18:18:04.317 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe63d7fa640 1 -- 10.20.193.52:0/1711937511 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fe62c0386b0 con 0x7fe6401046a0 2026-02-24T18:18:04.317 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe63d7fa640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:04.317 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe63d7fa640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:04.317 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe63d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:04.317 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe63d7fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:04.317 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe63d7fa640 1 --2- 10.20.193.52:0/1711937511 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe61403dc90 0x7fe614040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:04.317 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe63d7fa640 1 -- 10.20.193.52:0/1711937511 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe62c0770b0 con 0x7fe6401046a0 2026-02-24T18:18:04.318 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.311+0000 7fe63f7fe640 1 --2- 10.20.193.52:0/1711937511 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe61403dc90 0x7fe614040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:04.318 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.312+0000 7fe63f7fe640 1 --2- 10.20.193.52:0/1711937511 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe61403dc90 0x7fe614040150 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe6300099c0 tx=0x7fe630006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:04.319 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.314+0000 7fe63d7fa640 1 -- 10.20.193.52:0/1711937511 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe62c0389d0 con 0x7fe6401046a0 2026-02-24T18:18:04.402 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.400+0000 7fe64628f640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}] 2026-02-24T18:18:04.402 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:04.400+0000 7fe64628f640 1 -- 10.20.193.52:0/1711937511 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe6401948f0 con 0x7fe61403dc90 2026-02-24T18:18:04.580 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:04 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-24T18:18:04.580 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:04 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-24T18:18:04.580 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:04 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:05.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:05 trial052 ceph-mon[39446]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:18:05.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:05 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2111734287' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9f4f18e-df8e-4e3b-8e5f-88c26770f5bc"}]: dispatch 2026-02-24T18:18:05.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:05 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2111734287' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9f4f18e-df8e-4e3b-8e5f-88c26770f5bc"}]': finished 2026-02-24T18:18:05.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:05 trial052 ceph-mon[39446]: osdmap e5: 1 total, 0 up, 1 in 2026-02-24T18:18:05.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:05 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-24T18:18:05.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:05 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1444901262' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-24T18:18:10.898 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:10 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-24T18:18:10.898 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:10 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:12.199 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:11 trial052 ceph-mon[39446]: Deploying daemon osd.0 on trial052 2026-02-24T18:18:13.048 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:12 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:18:13.048 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:12 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:13.048 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:12 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:13.731 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.728+0000 7fe63d7fa640 1 -- 10.20.193.52:0/1711937511 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fe6401948f0 con 0x7fe61403dc90 2026-02-24T18:18:13.732 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.728+0000 7fe63d7fa640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:18:13.732 INFO:teuthology.orchestra.run.trial052.stdout:Created osd(s) 0 on host 'trial052' 2026-02-24T18:18:13.733 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 10 mgrc shutdown 2026-02-24T18:18:13.733 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 1 -- 10.20.193.52:0/1711937511 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe61403dc90 msgr2=0x7fe614040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:13.733 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 1 --2- 10.20.193.52:0/1711937511 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe61403dc90 0x7fe614040150 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe6300099c0 tx=0x7fe630006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:13.733 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 1 -- 10.20.193.52:0/1711937511 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe6401046a0 msgr2=0x7fe64019b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:13.734 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 1 --2- 10.20.193.52:0/1711937511 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe6401046a0 0x7fe64019b2c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe62c005ec0 tx=0x7fe62c004290 comp rx=0 tx=0).stop 2026-02-24T18:18:13.734 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 1 -- 10.20.193.52:0/1711937511 shutdown_connections 2026-02-24T18:18:13.734 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 1 --2- 10.20.193.52:0/1711937511 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe61403dc90 0x7fe614040150 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:13.734 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 1 --2- 10.20.193.52:0/1711937511 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe6401046a0 0x7fe64019b2c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:13.734 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 1 -- 10.20.193.52:0/1711937511 >> 10.20.193.52:0/1711937511 conn(0x7fe6400ffe30 msgr2=0x7fe6401004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:13.734 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 1 -- 10.20.193.52:0/1711937511 shutdown_connections 2026-02-24T18:18:13.734 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:13.730+0000 7fe64628f640 1 -- 10.20.193.52:0/1711937511 wait complete. 2026-02-24T18:18:13.769 DEBUG:teuthology.orchestra.run.trial052:osd.0> sudo journalctl -f -n 0 -u ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@osd.0.service 2026-02-24T18:18:13.771 INFO:tasks.cephadm:Deploying osd.1 on trial052 with /dev/vg_nvme/lv_3... 2026-02-24T18:18:13.771 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T18:18:13.970 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:14.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:14 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:14.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:14 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:14.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:14 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:14.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:14 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-24T18:18:14.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:14 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:14.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:14 trial052 ceph-mon[39446]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T18:18:14.215 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:14 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:18:14.216 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:14 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:14.216 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:14 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:14.965 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:14 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-0[51342]: 2026-02-24T18:18:14.660+0000 7f63f5ebd740 -1 Falling back to public interface 2026-02-24T18:18:15.110 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:15.126 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph orch daemon add osd trial052:vg_nvme/lv_3 2026-02-24T18:18:15.277 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:15.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.387+0000 7f87aabde640 1 -- 10.20.193.52:0/2754691946 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f87a4102420 msgr2=0x7f87a4102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:15.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.387+0000 7f87aabde640 1 --2- 10.20.193.52:0/2754691946 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f87a4102420 0x7f87a4102820 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f87940099b0 tx=0x7f879402f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:15.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.387+0000 7f87aabde640 1 -- 10.20.193.52:0/2754691946 shutdown_connections 2026-02-24T18:18:15.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.387+0000 7f87aabde640 1 --2- 10.20.193.52:0/2754691946 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f87a4102420 0x7f87a4102820 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:15.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.387+0000 7f87aabde640 1 -- 10.20.193.52:0/2754691946 >> 10.20.193.52:0/2754691946 conn(0x7f87a40fdbb0 msgr2=0x7f87a40ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:15.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.387+0000 7f87aabde640 1 -- 10.20.193.52:0/2754691946 shutdown_connections 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f87aabde640 1 -- 10.20.193.52:0/2754691946 wait complete. 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f87aabde640 1 Processor -- start 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f87aabde640 1 -- start start 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f87aabde640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f87a4102420 0x7f87a4199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f87aabde640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f87a41078a0 con 0x7f87a4102420 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f87a8953640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f87a4102420 0x7f87a4199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f87a8953640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f87a4102420 0x7f87a4199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:43694/0 (socket says 10.20.193.52:43694) 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f87a8953640 1 -- 10.20.193.52:0/1872092801 learned_addr learned my addr 10.20.193.52:0/1872092801 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f87a8953640 1 -- 10.20.193.52:0/1872092801 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a4199580 con 0x7f87a4102420 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f87a8953640 1 --2- 10.20.193.52:0/1872092801 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f87a4102420 0x7f87a4199040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8794005ec0 tx=0x7f8794004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.388+0000 7f8799ffb640 1 -- 10.20.193.52:0/1872092801 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8794038510 con 0x7f87a4102420 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f8799ffb640 1 -- 10.20.193.52:0/1872092801 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8794046070 con 0x7f87a4102420 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f87aabde640 1 -- 10.20.193.52:0/1872092801 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a4199810 con 0x7f87a4102420 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f8799ffb640 1 -- 10.20.193.52:0/1872092801 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8794041810 con 0x7f87a4102420 2026-02-24T18:18:15.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f87aabde640 1 -- 10.20.193.52:0/1872092801 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a419c500 con 0x7f87a4102420 2026-02-24T18:18:15.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f87aabde640 1 -- 10.20.193.52:0/1872092801 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a4108040 con 0x7f87a4102420 2026-02-24T18:18:15.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f8799ffb640 1 -- 10.20.193.52:0/1872092801 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f87940419b0 con 0x7f87a4102420 2026-02-24T18:18:15.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f8799ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:15.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f8799ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:15.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f8799ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:15.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f8799ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:15.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f8799ffb640 1 --2- 10.20.193.52:0/1872092801 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f878003dce0 0x7f87800401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:15.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f8799ffb640 1 -- 10.20.193.52:0/1872092801 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1270+0+0 (secure 0 0 0) 0x7f8794077280 con 0x7f87a4102420 2026-02-24T18:18:15.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.389+0000 7f879bfff640 1 --2- 10.20.193.52:0/1872092801 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f878003dce0 0x7f87800401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:15.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.390+0000 7f879bfff640 1 --2- 10.20.193.52:0/1872092801 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f878003dce0 0x7f87800401a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f878c0099c0 tx=0x7f878c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:15.394 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.392+0000 7f8799ffb640 1 -- 10.20.193.52:0/1872092801 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8794034280 con 0x7f87a4102420 2026-02-24T18:18:15.482 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.479+0000 7f87aabde640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}] 2026-02-24T18:18:15.482 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:15.479+0000 7f87aabde640 1 -- 10.20.193.52:0/1872092801 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f87a4192670 con 0x7f878003dce0 2026-02-24T18:18:15.663 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:15 trial052 ceph-mon[39446]: Detected new or changed devices on trial052 2026-02-24T18:18:15.664 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:15 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:15.664 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:15 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:15.664 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:15 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-24T18:18:15.664 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:15 trial052 ceph-mon[39446]: Adjusting osd_memory_target on trial052 to 84047M 2026-02-24T18:18:15.664 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:15 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:15.664 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:15 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:15.664 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:15 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-24T18:18:15.664 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:15 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:16.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T18:18:16.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:18:16.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-24T18:18:16.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-24T18:18:16.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:16.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/3586354657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4333ab0f-7dc0-4585-8888-50d9eee9be76"}]: dispatch 2026-02-24T18:18:16.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/3586354657' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4333ab0f-7dc0-4585-8888-50d9eee9be76"}]': finished 2026-02-24T18:18:16.717 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: osdmap e6: 2 total, 0 up, 2 in 2026-02-24T18:18:16.717 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-24T18:18:16.717 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:16.717 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:16 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2930401557' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-24T18:18:18.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:18 trial052 ceph-mon[39446]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T18:18:19.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:19 trial052 ceph-mon[39446]: from='osd.0 [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-24T18:18:19.716 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:19 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-0[51342]: 2026-02-24T18:18:19.223+0000 7f63f5ebd740 -1 osd.0 0 log_to_monitors true 2026-02-24T18:18:20.715 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:20 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-0[51342]: 2026-02-24T18:18:20.461+0000 7f63f1e1c640 -1 osd.0 0 waiting for initial osdmap 2026-02-24T18:18:20.715 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:20 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-0[51342]: 2026-02-24T18:18:20.464+0000 7f63edc57640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T18:18:20.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:20 trial052 ceph-mon[39446]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T18:18:20.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:20 trial052 ceph-mon[39446]: from='osd.0 [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T18:18:20.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:20 trial052 ceph-mon[39446]: osdmap e7: 2 total, 0 up, 2 in 2026-02-24T18:18:20.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:20 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-24T18:18:20.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:20 trial052 ceph-mon[39446]: from='osd.0 [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial052", "root=default"]}]: dispatch 2026-02-24T18:18:20.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:20 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:21.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:21 trial052 ceph-mon[39446]: from='osd.0 [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial052", "root=default"]}]': finished 2026-02-24T18:18:21.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:21 trial052 ceph-mon[39446]: osdmap e8: 2 total, 0 up, 2 in 2026-02-24T18:18:21.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:21 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-24T18:18:21.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:21 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:21.716 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:21 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-24T18:18:22.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:22 trial052 ceph-mon[39446]: purged_snaps scrub starts 2026-02-24T18:18:22.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:22 trial052 ceph-mon[39446]: purged_snaps scrub ok 2026-02-24T18:18:22.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:22 trial052 ceph-mon[39446]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T18:18:22.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:22 trial052 ceph-mon[39446]: osd.0 [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937] boot 2026-02-24T18:18:22.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:22 trial052 ceph-mon[39446]: osdmap e9: 2 total, 1 up, 2 in 2026-02-24T18:18:22.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:22 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-24T18:18:22.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:22 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:22.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:22 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-24T18:18:22.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:22 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:23.614 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:23 trial052 ceph-mon[39446]: Deploying daemon osd.1 on trial052 2026-02-24T18:18:23.614 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:23 trial052 ceph-mon[39446]: osdmap e10: 2 total, 1 up, 2 in 2026-02-24T18:18:23.614 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:23 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:24.722 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:24 trial052 ceph-mon[39446]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T18:18:24.722 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:24 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:18:24.722 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:24 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:24.722 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:24 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:24.722 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:24 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:24.723 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:24 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:24.723 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:24 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:24.723 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:24 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-24T18:18:24.723 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:24 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:24.754 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.752+0000 7f8799ffb640 1 -- 10.20.193.52:0/1872092801 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f87a4192670 con 0x7f878003dce0 2026-02-24T18:18:24.754 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.752+0000 7f8799ffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:18:24.754 INFO:teuthology.orchestra.run.trial052.stdout:Created osd(s) 1 on host 'trial052' 2026-02-24T18:18:24.755 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 10 mgrc shutdown 2026-02-24T18:18:24.755 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 1 -- 10.20.193.52:0/1872092801 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f878003dce0 msgr2=0x7f87800401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:24.756 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 1 --2- 10.20.193.52:0/1872092801 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f878003dce0 0x7f87800401a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f878c0099c0 tx=0x7f878c006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:24.756 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 1 -- 10.20.193.52:0/1872092801 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f87a4102420 msgr2=0x7f87a4199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:24.756 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 1 --2- 10.20.193.52:0/1872092801 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f87a4102420 0x7f87a4199040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8794005ec0 tx=0x7f8794004290 comp rx=0 tx=0).stop 2026-02-24T18:18:24.756 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 1 -- 10.20.193.52:0/1872092801 shutdown_connections 2026-02-24T18:18:24.756 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 1 --2- 10.20.193.52:0/1872092801 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f878003dce0 0x7f87800401a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:24.756 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 1 --2- 10.20.193.52:0/1872092801 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f87a4102420 0x7f87a4199040 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:24.756 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 1 -- 10.20.193.52:0/1872092801 >> 10.20.193.52:0/1872092801 conn(0x7f87a40fdbb0 msgr2=0x7f87a40fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:24.756 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 1 -- 10.20.193.52:0/1872092801 shutdown_connections 2026-02-24T18:18:24.756 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:24.754+0000 7f87aabde640 1 -- 10.20.193.52:0/1872092801 wait complete. 2026-02-24T18:18:24.791 DEBUG:teuthology.orchestra.run.trial052:osd.1> sudo journalctl -f -n 0 -u ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@osd.1.service 2026-02-24T18:18:24.793 INFO:tasks.cephadm:Deploying osd.2 on trial052 with /dev/vg_nvme/lv_2... 2026-02-24T18:18:24.793 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-24T18:18:24.994 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:25.684 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:25 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:18:25.684 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:25 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:25.684 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:25 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:25.965 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:25 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-1[57488]: 2026-02-24T18:18:25.682+0000 7f117d820740 -1 Falling back to public interface 2026-02-24T18:18:26.115 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:26.130 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph orch daemon add osd trial052:vg_nvme/lv_2 2026-02-24T18:18:26.281 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:26.389 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.385+0000 7f7ee52ec640 1 -- 10.20.193.52:0/3242280273 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7ee01046d0 msgr2=0x7f7ee0104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:26.390 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.385+0000 7f7ee52ec640 1 --2- 10.20.193.52:0/3242280273 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7ee01046d0 0x7f7ee0104ad0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40099b0 tx=0x7f7ed402f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:26.390 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.385+0000 7f7ee52ec640 1 -- 10.20.193.52:0/3242280273 shutdown_connections 2026-02-24T18:18:26.390 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.385+0000 7f7ee52ec640 1 --2- 10.20.193.52:0/3242280273 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7ee01046d0 0x7f7ee0104ad0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:26.390 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.385+0000 7f7ee52ec640 1 -- 10.20.193.52:0/3242280273 >> 10.20.193.52:0/3242280273 conn(0x7f7ee00ffe60 msgr2=0x7f7ee01022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:26.390 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.385+0000 7f7ee52ec640 1 -- 10.20.193.52:0/3242280273 shutdown_connections 2026-02-24T18:18:26.390 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.385+0000 7f7ee52ec640 1 -- 10.20.193.52:0/3242280273 wait complete. 2026-02-24T18:18:26.390 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7ee52ec640 1 Processor -- start 2026-02-24T18:18:26.390 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7ee52ec640 1 -- start start 2026-02-24T18:18:26.390 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7ee52ec640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7ee01046d0 0x7f7ee019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:26.390 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7ee52ec640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee0109b50 con 0x7f7ee01046d0 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7edeffd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7ee01046d0 0x7f7ee019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7edeffd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7ee01046d0 0x7f7ee019b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:38346/0 (socket says 10.20.193.52:38346) 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7edeffd640 1 -- 10.20.193.52:0/2228074501 learned_addr learned my addr 10.20.193.52:0/2228074501 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7edeffd640 1 -- 10.20.193.52:0/2228074501 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee019b7f0 con 0x7f7ee01046d0 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7edeffd640 1 --2- 10.20.193.52:0/2228074501 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7ee01046d0 0x7f7ee019b2b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4005ec0 tx=0x7f7ed4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7ebffff640 1 -- 10.20.193.52:0/2228074501 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ed4038510 con 0x7f7ee01046d0 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7ebffff640 1 -- 10.20.193.52:0/2228074501 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7ed4046070 con 0x7f7ee01046d0 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7ee52ec640 1 -- 10.20.193.52:0/2228074501 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee019ba80 con 0x7f7ee01046d0 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7ebffff640 1 -- 10.20.193.52:0/2228074501 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ed4041810 con 0x7f7ee01046d0 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.386+0000 7f7ee52ec640 1 -- 10.20.193.52:0/2228074501 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee019e770 con 0x7f7ee01046d0 2026-02-24T18:18:26.391 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.387+0000 7f7ee52ec640 1 -- 10.20.193.52:0/2228074501 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee010a2f0 con 0x7f7ee01046d0 2026-02-24T18:18:26.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.387+0000 7f7ebffff640 1 -- 10.20.193.52:0/2228074501 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f7ed40386b0 con 0x7f7ee01046d0 2026-02-24T18:18:26.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.387+0000 7f7ebffff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:26.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.387+0000 7f7ebffff640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:26.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.387+0000 7f7ebffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:26.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.387+0000 7f7ebffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:26.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.387+0000 7f7ebffff640 1 --2- 10.20.193.52:0/2228074501 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7eb403dce0 0x7f7eb40401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:26.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.387+0000 7f7ebffff640 1 -- 10.20.193.52:0/2228074501 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1880+0+0 (secure 0 0 0) 0x7f7ed4077340 con 0x7f7ee01046d0 2026-02-24T18:18:26.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.387+0000 7f7ede7fc640 1 --2- 10.20.193.52:0/2228074501 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7eb403dce0 0x7f7eb40401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:26.392 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.387+0000 7f7ede7fc640 1 --2- 10.20.193.52:0/2228074501 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7eb403dce0 0x7f7eb40401a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80099c0 tx=0x7f7ec8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:26.393 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.390+0000 7f7ebffff640 1 -- 10.20.193.52:0/2228074501 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7ed40389d0 con 0x7f7ee01046d0 2026-02-24T18:18:26.477 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.476+0000 7f7ee52ec640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}] 2026-02-24T18:18:26.477 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:26.476+0000 7f7ee52ec640 1 -- 10.20.193.52:0/2228074501 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7ee0194950 con 0x7f7eb403dce0 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: pgmap v16: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: Detected new or changed devices on trial052 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: Adjusting osd_memory_target on trial052 to 42023M 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-24T18:18:26.655 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:26 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:27.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:27 trial052 ceph-mon[39446]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T18:18:27.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:27 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-24T18:18:27.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:27 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-24T18:18:27.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:27 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:27.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:27 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1997830439' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2595bd04-35f8-4296-b0be-313e8f0305c6"}]: dispatch 2026-02-24T18:18:27.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:27 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1997830439' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2595bd04-35f8-4296-b0be-313e8f0305c6"}]': finished 2026-02-24T18:18:27.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:27 trial052 ceph-mon[39446]: osdmap e11: 3 total, 1 up, 3 in 2026-02-24T18:18:27.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:27 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:27.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:27 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-24T18:18:27.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:27 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/862238752' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-24T18:18:28.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:28 trial052 ceph-mon[39446]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T18:18:30.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:30 trial052 ceph-mon[39446]: pgmap v19: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T18:18:30.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:30 trial052 ceph-mon[39446]: from='osd.1 [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-24T18:18:30.715 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:30 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-1[57488]: 2026-02-24T18:18:30.235+0000 7f117d820740 -1 osd.1 0 log_to_monitors true 2026-02-24T18:18:31.898 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:31 trial052 ceph-mon[39446]: from='osd.1 [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T18:18:31.898 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:31 trial052 ceph-mon[39446]: osdmap e12: 3 total, 1 up, 3 in 2026-02-24T18:18:31.898 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:31 trial052 ceph-mon[39446]: from='osd.1 [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial052", "root=default"]}]: dispatch 2026-02-24T18:18:31.898 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:31 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:31.898 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:31 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-24T18:18:31.898 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:31 trial052 ceph-mon[39446]: from='osd.1 [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial052", "root=default"]}]': finished 2026-02-24T18:18:31.898 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:31 trial052 ceph-mon[39446]: osdmap e13: 3 total, 1 up, 3 in 2026-02-24T18:18:31.899 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:31 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-1[57488]: 2026-02-24T18:18:31.480+0000 7f117977f640 -1 osd.1 0 waiting for initial osdmap 2026-02-24T18:18:31.899 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:31 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-1[57488]: 2026-02-24T18:18:31.482+0000 7f11755ba640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T18:18:32.763 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:32 trial052 ceph-mon[39446]: pgmap v21: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T18:18:32.763 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:32 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:32.763 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:32 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-24T18:18:32.763 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:32 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:33.572 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:33 trial052 ceph-mon[39446]: purged_snaps scrub starts 2026-02-24T18:18:33.572 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:33 trial052 ceph-mon[39446]: purged_snaps scrub ok 2026-02-24T18:18:33.572 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:33 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:33.572 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:33 trial052 ceph-mon[39446]: osd.1 [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205] boot 2026-02-24T18:18:33.573 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:33 trial052 ceph-mon[39446]: osdmap e14: 3 total, 2 up, 3 in 2026-02-24T18:18:33.573 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:33 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-24T18:18:33.573 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:33 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-24T18:18:33.573 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:33 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-24T18:18:33.573 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:33 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:34.904 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:34 trial052 ceph-mon[39446]: Deploying daemon osd.2 on trial052 2026-02-24T18:18:34.904 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:34 trial052 ceph-mon[39446]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T18:18:34.904 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:34 trial052 ceph-mon[39446]: osdmap e15: 3 total, 2 up, 3 in 2026-02-24T18:18:34.904 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:34 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-24T18:18:35.563 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.560+0000 7f7ebffff640 1 -- 10.20.193.52:0/2228074501 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f7ee0194950 con 0x7f7eb403dce0 2026-02-24T18:18:35.564 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.560+0000 7f7ebffff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:18:35.564 INFO:teuthology.orchestra.run.trial052.stdout:Created osd(s) 2 on host 'trial052' 2026-02-24T18:18:35.566 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 10 mgrc shutdown 2026-02-24T18:18:35.566 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 1 -- 10.20.193.52:0/2228074501 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7eb403dce0 msgr2=0x7f7eb40401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:35.566 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 1 --2- 10.20.193.52:0/2228074501 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7eb403dce0 0x7f7eb40401a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80099c0 tx=0x7f7ec8006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:35.566 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 1 -- 10.20.193.52:0/2228074501 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7ee01046d0 msgr2=0x7f7ee019b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:35.566 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 1 --2- 10.20.193.52:0/2228074501 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7ee01046d0 0x7f7ee019b2b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4005ec0 tx=0x7f7ed4004290 comp rx=0 tx=0).stop 2026-02-24T18:18:35.566 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 1 -- 10.20.193.52:0/2228074501 shutdown_connections 2026-02-24T18:18:35.566 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 1 --2- 10.20.193.52:0/2228074501 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f7eb403dce0 0x7f7eb40401a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:35.566 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 1 --2- 10.20.193.52:0/2228074501 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f7ee01046d0 0x7f7ee019b2b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:35.566 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 1 -- 10.20.193.52:0/2228074501 >> 10.20.193.52:0/2228074501 conn(0x7f7ee00ffe60 msgr2=0x7f7ee0100950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:35.567 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 1 -- 10.20.193.52:0/2228074501 shutdown_connections 2026-02-24T18:18:35.567 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.563+0000 7f7ee52ec640 1 -- 10.20.193.52:0/2228074501 wait complete. 2026-02-24T18:18:35.601 DEBUG:teuthology.orchestra.run.trial052:osd.2> sudo journalctl -f -n 0 -u ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460@osd.2.service 2026-02-24T18:18:35.603 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2026-02-24T18:18:35.603 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T18:18:35.746 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:35 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:18:35.746 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:35 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:35.746 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:35 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:35.746 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:35 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:35.746 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:35 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:35.746 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:35 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:35.746 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:35 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-24T18:18:35.746 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:35 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:35.810 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:35.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.917+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2703463432 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe474102460 msgr2=0x7fe474102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:35.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.917+0000 7fe47b1e6640 1 --2- 10.20.193.52:0/2703463432 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe474102460 0x7fe474102860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4640099b0 tx=0x7fe46402f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:35.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.917+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2703463432 shutdown_connections 2026-02-24T18:18:35.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.917+0000 7fe47b1e6640 1 --2- 10.20.193.52:0/2703463432 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe474102460 0x7fe474102860 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:35.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.917+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2703463432 >> 10.20.193.52:0/2703463432 conn(0x7fe4740fdc10 msgr2=0x7fe474100030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:35.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.917+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2703463432 shutdown_connections 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.917+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2703463432 wait complete. 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe47b1e6640 1 Processor -- start 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe47b1e6640 1 -- start start 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe47b1e6640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe474102460 0x7fe4741990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe47b1e6640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe4741078e0 con 0x7fe474102460 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe478f5b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe474102460 0x7fe4741990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe478f5b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe474102460 0x7fe4741990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:52832/0 (socket says 10.20.193.52:52832) 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe478f5b640 1 -- 10.20.193.52:0/2968018128 learned_addr learned my addr 10.20.193.52:0/2968018128 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe478f5b640 1 -- 10.20.193.52:0/2968018128 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4741995e0 con 0x7fe474102460 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe478f5b640 1 --2- 10.20.193.52:0/2968018128 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe474102460 0x7fe4741990a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe464004290 tx=0x7fe4640042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe469ffb640 1 -- 10.20.193.52:0/2968018128 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe464038510 con 0x7fe474102460 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2968018128 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe474199870 con 0x7fe474102460 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe469ffb640 1 -- 10.20.193.52:0/2968018128 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe464046070 con 0x7fe474102460 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe469ffb640 1 -- 10.20.193.52:0/2968018128 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe464041870 con 0x7fe474102460 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.918+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2968018128 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe47419c560 con 0x7fe474102460 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.919+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2968018128 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe474108080 con 0x7fe474102460 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.919+0000 7fe469ffb640 1 -- 10.20.193.52:0/2968018128 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fe4640386b0 con 0x7fe474102460 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.919+0000 7fe469ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.919+0000 7fe469ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:35.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.919+0000 7fe469ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:35.922 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.919+0000 7fe469ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:35.922 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.919+0000 7fe469ffb640 1 --2- 10.20.193.52:0/2968018128 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe45003dc90 0x7fe450040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:35.922 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.919+0000 7fe469ffb640 1 -- 10.20.193.52:0/2968018128 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7fe4640775a0 con 0x7fe474102460 2026-02-24T18:18:35.922 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.919+0000 7fe46bfff640 1 --2- 10.20.193.52:0/2968018128 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe45003dc90 0x7fe450040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:35.922 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.919+0000 7fe46bfff640 1 --2- 10.20.193.52:0/2968018128 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe45003dc90 0x7fe450040150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0099c0 tx=0x7fe45c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:35.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:35.922+0000 7fe469ffb640 1 -- 10.20.193.52:0/2968018128 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe464040360 con 0x7fe474102460 2026-02-24T18:18:36.009 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.006+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2968018128 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe474192670 con 0x7fe474102460 2026-02-24T18:18:36.010 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:36.011 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.006+0000 7fe469ffb640 1 -- 10.20.193.52:0/2968018128 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7fe464038b20 con 0x7fe474102460 2026-02-24T18:18:36.012 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 10 mgrc shutdown 2026-02-24T18:18:36.012 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2968018128 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe45003dc90 msgr2=0x7fe450040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:36.012 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 1 --2- 10.20.193.52:0/2968018128 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe45003dc90 0x7fe450040150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0099c0 tx=0x7fe45c006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:36.012 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2968018128 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe474102460 msgr2=0x7fe4741990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:36.012 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 1 --2- 10.20.193.52:0/2968018128 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe474102460 0x7fe4741990a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe464004290 tx=0x7fe4640042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:36.012 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2968018128 shutdown_connections 2026-02-24T18:18:36.012 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 1 --2- 10.20.193.52:0/2968018128 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe45003dc90 0x7fe450040150 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:36.012 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 1 --2- 10.20.193.52:0/2968018128 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe474102460 0x7fe4741990a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:36.012 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2968018128 >> 10.20.193.52:0/2968018128 conn(0x7fe4740fdc10 msgr2=0x7fe4740fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:36.013 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2968018128 shutdown_connections 2026-02-24T18:18:36.013 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:36.007+0000 7fe47b1e6640 1 -- 10.20.193.52:0/2968018128 wait complete. 2026-02-24T18:18:36.046 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771957112,"num_in_osds":3,"osd_in_since":1771957107,"num_remapped_pgs":0} 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2968018128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-24T18:18:36.568 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:36 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:36.965 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:36 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-2[63533]: 2026-02-24T18:18:36.594+0000 7f79796a0740 -1 Falling back to public interface 2026-02-24T18:18:37.047 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T18:18:37.198 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:37.310 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.305+0000 7f75f1494640 1 -- 10.20.193.52:0/2358042457 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ec1046a0 msgr2=0x7f75ec104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:37.311 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.305+0000 7f75f1494640 1 --2- 10.20.193.52:0/2358042457 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ec1046a0 0x7f75ec104aa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75e00099b0 tx=0x7f75e002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:37.311 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.305+0000 7f75f1494640 1 -- 10.20.193.52:0/2358042457 shutdown_connections 2026-02-24T18:18:37.311 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.305+0000 7f75f1494640 1 --2- 10.20.193.52:0/2358042457 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ec1046a0 0x7f75ec104aa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:37.311 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.305+0000 7f75f1494640 1 -- 10.20.193.52:0/2358042457 >> 10.20.193.52:0/2358042457 conn(0x7f75ec0ffe30 msgr2=0x7f75ec102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:37.311 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.305+0000 7f75f1494640 1 -- 10.20.193.52:0/2358042457 shutdown_connections 2026-02-24T18:18:37.311 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.305+0000 7f75f1494640 1 -- 10.20.193.52:0/2358042457 wait complete. 2026-02-24T18:18:37.311 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75f1494640 1 Processor -- start 2026-02-24T18:18:37.311 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75f1494640 1 -- start start 2026-02-24T18:18:37.311 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75f1494640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ec1046a0 0x7f75ec19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:37.311 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75f1494640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec109b20 con 0x7f75ec1046a0 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75eaffd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ec1046a0 0x7f75ec19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75eaffd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ec1046a0 0x7f75ec19b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:52844/0 (socket says 10.20.193.52:52844) 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75eaffd640 1 -- 10.20.193.52:0/2441630834 learned_addr learned my addr 10.20.193.52:0/2441630834 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75eaffd640 1 -- 10.20.193.52:0/2441630834 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec19b800 con 0x7f75ec1046a0 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75eaffd640 1 --2- 10.20.193.52:0/2441630834 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ec1046a0 0x7f75ec19b2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f75e0005ec0 tx=0x7f75e0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75cbfff640 1 -- 10.20.193.52:0/2441630834 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e0038510 con 0x7f75ec1046a0 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75cbfff640 1 -- 10.20.193.52:0/2441630834 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f75e0046070 con 0x7f75ec1046a0 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75f1494640 1 -- 10.20.193.52:0/2441630834 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec19ba90 con 0x7f75ec1046a0 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75cbfff640 1 -- 10.20.193.52:0/2441630834 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e0041810 con 0x7f75ec1046a0 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.306+0000 7f75f1494640 1 -- 10.20.193.52:0/2441630834 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec19e780 con 0x7f75ec1046a0 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.307+0000 7f75f1494640 1 -- 10.20.193.52:0/2441630834 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ec10a2c0 con 0x7f75ec1046a0 2026-02-24T18:18:37.312 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.307+0000 7f75cbfff640 1 -- 10.20.193.52:0/2441630834 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f75e00386b0 con 0x7f75ec1046a0 2026-02-24T18:18:37.313 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.307+0000 7f75cbfff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:37.313 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.307+0000 7f75cbfff640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:37.313 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.307+0000 7f75cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:37.313 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.307+0000 7f75cbfff640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:37.313 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.307+0000 7f75cbfff640 1 --2- 10.20.193.52:0/2441630834 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f75c003dc90 0x7f75c0040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:37.313 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.307+0000 7f75cbfff640 1 -- 10.20.193.52:0/2441630834 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7f75e0077540 con 0x7f75ec1046a0 2026-02-24T18:18:37.313 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.307+0000 7f75ea7fc640 1 --2- 10.20.193.52:0/2441630834 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f75c003dc90 0x7f75c0040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:37.313 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.308+0000 7f75ea7fc640 1 --2- 10.20.193.52:0/2441630834 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f75c003dc90 0x7f75c0040150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f75d40099c0 tx=0x7f75d4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:37.314 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.310+0000 7f75cbfff640 1 -- 10.20.193.52:0/2441630834 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f75e00389d0 con 0x7f75ec1046a0 2026-02-24T18:18:37.397 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.394+0000 7f75f1494640 1 -- 10.20.193.52:0/2441630834 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f75ec194880 con 0x7f75ec1046a0 2026-02-24T18:18:37.397 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.394+0000 7f75cbfff640 1 -- 10.20.193.52:0/2441630834 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7f75e004a3c0 con 0x7f75ec1046a0 2026-02-24T18:18:37.398 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:37.399 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 10 mgrc shutdown 2026-02-24T18:18:37.399 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 1 -- 10.20.193.52:0/2441630834 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f75c003dc90 msgr2=0x7f75c0040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:37.399 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 1 --2- 10.20.193.52:0/2441630834 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f75c003dc90 0x7f75c0040150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f75d40099c0 tx=0x7f75d4006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:37.399 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 1 -- 10.20.193.52:0/2441630834 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ec1046a0 msgr2=0x7f75ec19b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:37.399 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 1 --2- 10.20.193.52:0/2441630834 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ec1046a0 0x7f75ec19b2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f75e0005ec0 tx=0x7f75e0004290 comp rx=0 tx=0).stop 2026-02-24T18:18:37.399 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 1 -- 10.20.193.52:0/2441630834 shutdown_connections 2026-02-24T18:18:37.399 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 1 --2- 10.20.193.52:0/2441630834 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f75c003dc90 0x7f75c0040150 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:37.399 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 1 --2- 10.20.193.52:0/2441630834 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ec1046a0 0x7f75ec19b2c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:37.400 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 1 -- 10.20.193.52:0/2441630834 >> 10.20.193.52:0/2441630834 conn(0x7f75ec0ffe30 msgr2=0x7f75ec1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:37.400 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 1 -- 10.20.193.52:0/2441630834 shutdown_connections 2026-02-24T18:18:37.400 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:37.395+0000 7f75f1494640 1 -- 10.20.193.52:0/2441630834 wait complete. 2026-02-24T18:18:37.448 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771957112,"num_in_osds":3,"osd_in_since":1771957107,"num_remapped_pgs":0} 2026-02-24T18:18:37.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:37 trial052 ceph-mon[39446]: Detected new or changed devices on trial052 2026-02-24T18:18:37.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:37 trial052 ceph-mon[39446]: Adjusting osd_memory_target on trial052 to 28015M 2026-02-24T18:18:37.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:37 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2441630834' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-24T18:18:38.449 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T18:18:38.599 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:38.703 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 -- 10.20.193.52:0/4273711165 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f176c1046d0 msgr2=0x7f176c104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:38.703 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 --2- 10.20.193.52:0/4273711165 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f176c1046d0 0x7f176c104ad0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f17600099b0 tx=0x7f176002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:38.703 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 -- 10.20.193.52:0/4273711165 shutdown_connections 2026-02-24T18:18:38.703 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 --2- 10.20.193.52:0/4273711165 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f176c1046d0 0x7f176c104ad0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:38.703 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 -- 10.20.193.52:0/4273711165 >> 10.20.193.52:0/4273711165 conn(0x7f176c0ffe60 msgr2=0x7f176c1022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:38.703 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 -- 10.20.193.52:0/4273711165 shutdown_connections 2026-02-24T18:18:38.703 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 -- 10.20.193.52:0/4273711165 wait complete. 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 Processor -- start 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 -- start start 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f176c1046d0 0x7f176c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f1770d73640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f176c109b50 con 0x7f176c1046d0 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f176a575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f176c1046d0 0x7f176c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f176a575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f176c1046d0 0x7f176c19b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:52864/0 (socket says 10.20.193.52:52864) 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.698+0000 7f176a575640 1 -- 10.20.193.52:0/1666263749 learned_addr learned my addr 10.20.193.52:0/1666263749 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.699+0000 7f176a575640 1 -- 10.20.193.52:0/1666263749 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c19b7f0 con 0x7f176c1046d0 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.699+0000 7f176a575640 1 --2- 10.20.193.52:0/1666263749 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f176c1046d0 0x7f176c19b2b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1760005ec0 tx=0x7f1760004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.699+0000 7f17537fe640 1 -- 10.20.193.52:0/1666263749 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1760038510 con 0x7f176c1046d0 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.699+0000 7f17537fe640 1 -- 10.20.193.52:0/1666263749 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1760046070 con 0x7f176c1046d0 2026-02-24T18:18:38.704 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.699+0000 7f1770d73640 1 -- 10.20.193.52:0/1666263749 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176c19ba80 con 0x7f176c1046d0 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.699+0000 7f17537fe640 1 -- 10.20.193.52:0/1666263749 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1760041810 con 0x7f176c1046d0 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.699+0000 7f1770d73640 1 -- 10.20.193.52:0/1666263749 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176c19e770 con 0x7f176c1046d0 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.699+0000 7f1770d73640 1 -- 10.20.193.52:0/1666263749 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176c10a2f0 con 0x7f176c1046d0 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.700+0000 7f17537fe640 1 -- 10.20.193.52:0/1666263749 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f17600386b0 con 0x7f176c1046d0 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.700+0000 7f17537fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.700+0000 7f17537fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.700+0000 7f17537fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.700+0000 7f17537fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.700+0000 7f17537fe640 1 --2- 10.20.193.52:0/1666263749 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f174403dce0 0x7f17440401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.700+0000 7f17537fe640 1 -- 10.20.193.52:0/1666263749 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7f17600774f0 con 0x7f176c1046d0 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.700+0000 7f1769d74640 1 --2- 10.20.193.52:0/1666263749 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f174403dce0 0x7f17440401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:38.705 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.700+0000 7f1769d74640 1 --2- 10.20.193.52:0/1666263749 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f174403dce0 0x7f17440401a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f17540099c0 tx=0x7f1754006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:38.706 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.702+0000 7f17537fe640 1 -- 10.20.193.52:0/1666263749 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f17600389d0 con 0x7f176c1046d0 2026-02-24T18:18:38.790 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.787+0000 7f1770d73640 1 -- 10.20.193.52:0/1666263749 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f176c1948b0 con 0x7f176c1046d0 2026-02-24T18:18:38.791 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:38 trial052 ceph-mon[39446]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T18:18:38.791 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.788+0000 7f17537fe640 1 -- 10.20.193.52:0/1666263749 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7f1760007c50 con 0x7f176c1046d0 2026-02-24T18:18:38.792 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:38.792 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 10 mgrc shutdown 2026-02-24T18:18:38.793 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 1 -- 10.20.193.52:0/1666263749 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f174403dce0 msgr2=0x7f17440401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:38.793 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 1 --2- 10.20.193.52:0/1666263749 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f174403dce0 0x7f17440401a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f17540099c0 tx=0x7f1754006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:38.793 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 1 -- 10.20.193.52:0/1666263749 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f176c1046d0 msgr2=0x7f176c19b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:38.793 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 1 --2- 10.20.193.52:0/1666263749 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f176c1046d0 0x7f176c19b2b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1760005ec0 tx=0x7f1760004290 comp rx=0 tx=0).stop 2026-02-24T18:18:38.793 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 1 -- 10.20.193.52:0/1666263749 shutdown_connections 2026-02-24T18:18:38.793 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 1 --2- 10.20.193.52:0/1666263749 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f174403dce0 0x7f17440401a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:38.793 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 1 --2- 10.20.193.52:0/1666263749 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f176c1046d0 0x7f176c19b2b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:38.793 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 1 -- 10.20.193.52:0/1666263749 >> 10.20.193.52:0/1666263749 conn(0x7f176c0ffe60 msgr2=0x7f176c100950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:38.793 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 1 -- 10.20.193.52:0/1666263749 shutdown_connections 2026-02-24T18:18:38.793 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:38.789+0000 7f1770d73640 1 -- 10.20.193.52:0/1666263749 wait complete. 2026-02-24T18:18:38.826 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771957112,"num_in_osds":3,"osd_in_since":1771957107,"num_remapped_pgs":0} 2026-02-24T18:18:39.827 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T18:18:39.849 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:39 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1666263749' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-24T18:18:39.978 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.077+0000 7fd5e2fca640 1 -- 10.20.193.52:0/3897544795 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd5dc102420 msgr2=0x7fd5dc102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.077+0000 7fd5e2fca640 1 --2- 10.20.193.52:0/3897544795 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd5dc102420 0x7fd5dc102820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0099b0 tx=0x7fd5cc02f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.077+0000 7fd5e2fca640 1 -- 10.20.193.52:0/3897544795 shutdown_connections 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.077+0000 7fd5e2fca640 1 --2- 10.20.193.52:0/3897544795 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd5dc102420 0x7fd5dc102820 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.077+0000 7fd5e2fca640 1 -- 10.20.193.52:0/3897544795 >> 10.20.193.52:0/3897544795 conn(0x7fd5dc0fdbb0 msgr2=0x7fd5dc0ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.077+0000 7fd5e2fca640 1 -- 10.20.193.52:0/3897544795 shutdown_connections 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.077+0000 7fd5e2fca640 1 -- 10.20.193.52:0/3897544795 wait complete. 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.078+0000 7fd5e2fca640 1 Processor -- start 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.078+0000 7fd5e2fca640 1 -- start start 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.078+0000 7fd5e2fca640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd5dc102420 0x7fd5dc199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.078+0000 7fd5e2fca640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc1078a0 con 0x7fd5dc102420 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.078+0000 7fd5e0d3f640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd5dc102420 0x7fd5dc199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.078+0000 7fd5e0d3f640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd5dc102420 0x7fd5dc199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:52894/0 (socket says 10.20.193.52:52894) 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.078+0000 7fd5e0d3f640 1 -- 10.20.193.52:0/609651687 learned_addr learned my addr 10.20.193.52:0/609651687 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:40.081 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.078+0000 7fd5e0d3f640 1 -- 10.20.193.52:0/609651687 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc199580 con 0x7fd5dc102420 2026-02-24T18:18:40.082 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.078+0000 7fd5e0d3f640 1 --2- 10.20.193.52:0/609651687 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd5dc102420 0x7fd5dc199040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc005ec0 tx=0x7fd5cc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:40.082 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.078+0000 7fd5d1ffb640 1 -- 10.20.193.52:0/609651687 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5cc038510 con 0x7fd5dc102420 2026-02-24T18:18:40.082 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5e2fca640 1 -- 10.20.193.52:0/609651687 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc199810 con 0x7fd5dc102420 2026-02-24T18:18:40.082 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5e2fca640 1 -- 10.20.193.52:0/609651687 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc19c500 con 0x7fd5dc102420 2026-02-24T18:18:40.082 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5d1ffb640 1 -- 10.20.193.52:0/609651687 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fd5cc033020 con 0x7fd5dc102420 2026-02-24T18:18:40.082 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5d1ffb640 1 -- 10.20.193.52:0/609651687 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5cc04b5f0 con 0x7fd5dc102420 2026-02-24T18:18:40.082 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5e2fca640 1 -- 10.20.193.52:0/609651687 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc108040 con 0x7fd5dc102420 2026-02-24T18:18:40.084 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5d1ffb640 1 -- 10.20.193.52:0/609651687 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fd5cc0386b0 con 0x7fd5dc102420 2026-02-24T18:18:40.084 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5d1ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:40.084 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5d1ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:40.084 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5d1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:40.084 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5d1ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:40.084 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.079+0000 7fd5d1ffb640 1 --2- 10.20.193.52:0/609651687 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd5b803dc90 0x7fd5b8040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:40.084 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.080+0000 7fd5d1ffb640 1 -- 10.20.193.52:0/609651687 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7fd5cc0775e0 con 0x7fd5dc102420 2026-02-24T18:18:40.084 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.080+0000 7fd5d3fff640 1 --2- 10.20.193.52:0/609651687 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd5b803dc90 0x7fd5b8040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:40.084 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.080+0000 7fd5d3fff640 1 --2- 10.20.193.52:0/609651687 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd5b803dc90 0x7fd5b8040150 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40099c0 tx=0x7fd5c4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:40.085 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.082+0000 7fd5d1ffb640 1 -- 10.20.193.52:0/609651687 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd5cc050020 con 0x7fd5dc102420 2026-02-24T18:18:40.171 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.168+0000 7fd5e2fca640 1 -- 10.20.193.52:0/609651687 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd5dc192600 con 0x7fd5dc102420 2026-02-24T18:18:40.171 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.168+0000 7fd5d1ffb640 1 -- 10.20.193.52:0/609651687 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7fd5cc040e40 con 0x7fd5dc102420 2026-02-24T18:18:40.171 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 10 mgrc shutdown 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 1 -- 10.20.193.52:0/609651687 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd5b803dc90 msgr2=0x7fd5b8040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 1 --2- 10.20.193.52:0/609651687 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd5b803dc90 0x7fd5b8040150 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40099c0 tx=0x7fd5c4006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 1 -- 10.20.193.52:0/609651687 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd5dc102420 msgr2=0x7fd5dc199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 1 --2- 10.20.193.52:0/609651687 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd5dc102420 0x7fd5dc199040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc005ec0 tx=0x7fd5cc004290 comp rx=0 tx=0).stop 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 1 -- 10.20.193.52:0/609651687 shutdown_connections 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 1 --2- 10.20.193.52:0/609651687 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fd5b803dc90 0x7fd5b8040150 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 1 --2- 10.20.193.52:0/609651687 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fd5dc102420 0x7fd5dc199040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 1 -- 10.20.193.52:0/609651687 >> 10.20.193.52:0/609651687 conn(0x7fd5dc0fdbb0 msgr2=0x7fd5dc0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 1 -- 10.20.193.52:0/609651687 shutdown_connections 2026-02-24T18:18:40.172 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:40.170+0000 7fd5e2fca640 1 -- 10.20.193.52:0/609651687 wait complete. 2026-02-24T18:18:40.207 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771957112,"num_in_osds":3,"osd_in_since":1771957107,"num_remapped_pgs":0} 2026-02-24T18:18:40.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:40 trial052 ceph-mon[39446]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T18:18:40.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:40 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/609651687' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-24T18:18:41.209 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T18:18:41.355 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:41.376 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:41 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-2[63533]: 2026-02-24T18:18:41.093+0000 7f79796a0740 -1 osd.2 0 log_to_monitors true 2026-02-24T18:18:41.466 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 -- 10.20.193.52:0/3534712059 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9a4c1046d0 msgr2=0x7f9a4c104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:41.466 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 --2- 10.20.193.52:0/3534712059 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9a4c1046d0 0x7f9a4c104ad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a400099b0 tx=0x7f9a4002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:41.466 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 -- 10.20.193.52:0/3534712059 shutdown_connections 2026-02-24T18:18:41.466 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 --2- 10.20.193.52:0/3534712059 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9a4c1046d0 0x7f9a4c104ad0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 -- 10.20.193.52:0/3534712059 >> 10.20.193.52:0/3534712059 conn(0x7f9a4c0ffe60 msgr2=0x7f9a4c1022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 -- 10.20.193.52:0/3534712059 shutdown_connections 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 -- 10.20.193.52:0/3534712059 wait complete. 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 Processor -- start 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 -- start start 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9a4c1046d0 0x7f9a4c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a50c2d640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c109b50 con 0x7f9a4c1046d0 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a4a575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9a4c1046d0 0x7f9a4c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a4a575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9a4c1046d0 0x7f9a4c19b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:52926/0 (socket says 10.20.193.52:52926) 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.461+0000 7f9a4a575640 1 -- 10.20.193.52:0/1971662820 learned_addr learned my addr 10.20.193.52:0/1971662820 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:41.467 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.462+0000 7f9a4a575640 1 -- 10.20.193.52:0/1971662820 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c19b7f0 con 0x7f9a4c1046d0 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.462+0000 7f9a4a575640 1 --2- 10.20.193.52:0/1971662820 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9a4c1046d0 0x7f9a4c19b2b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005ec0 tx=0x7f9a40004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.462+0000 7f9a337fe640 1 -- 10.20.193.52:0/1971662820 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a40038510 con 0x7f9a4c1046d0 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.462+0000 7f9a337fe640 1 -- 10.20.193.52:0/1971662820 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f9a40046070 con 0x7f9a4c1046d0 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.462+0000 7f9a50c2d640 1 -- 10.20.193.52:0/1971662820 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4c19ba80 con 0x7f9a4c1046d0 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.462+0000 7f9a337fe640 1 -- 10.20.193.52:0/1971662820 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a40041810 con 0x7f9a4c1046d0 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.462+0000 7f9a50c2d640 1 -- 10.20.193.52:0/1971662820 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4c19e770 con 0x7f9a4c1046d0 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.462+0000 7f9a50c2d640 1 -- 10.20.193.52:0/1971662820 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a4c10a2f0 con 0x7f9a4c1046d0 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.463+0000 7f9a337fe640 1 -- 10.20.193.52:0/1971662820 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f9a400386b0 con 0x7f9a4c1046d0 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.463+0000 7f9a337fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.463+0000 7f9a337fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.463+0000 7f9a337fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:41.468 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.463+0000 7f9a337fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:41.469 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.463+0000 7f9a337fe640 1 --2- 10.20.193.52:0/1971662820 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f9a2403dce0 0x7f9a240401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:41.469 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.463+0000 7f9a337fe640 1 -- 10.20.193.52:0/1971662820 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7f9a40077d60 con 0x7f9a4c1046d0 2026-02-24T18:18:41.469 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.463+0000 7f9a49d74640 1 --2- 10.20.193.52:0/1971662820 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f9a2403dce0 0x7f9a240401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:41.469 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.463+0000 7f9a49d74640 1 --2- 10.20.193.52:0/1971662820 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f9a2403dce0 0x7f9a240401a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a340099c0 tx=0x7f9a34006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:41.469 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.465+0000 7f9a337fe640 1 -- 10.20.193.52:0/1971662820 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9a40038d00 con 0x7f9a4c1046d0 2026-02-24T18:18:41.551 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.548+0000 7f9a50c2d640 1 -- 10.20.193.52:0/1971662820 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9a4c1948e0 con 0x7f9a4c1046d0 2026-02-24T18:18:41.551 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.548+0000 7f9a337fe640 1 -- 10.20.193.52:0/1971662820 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v16) ==== 74+0+130 (secure 0 0 0) 0x7f9a400419b0 con 0x7f9a4c1046d0 2026-02-24T18:18:41.552 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:41.553 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.548+0000 7f9a50c2d640 10 mgrc shutdown 2026-02-24T18:18:41.553 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.548+0000 7f9a50c2d640 1 -- 10.20.193.52:0/1971662820 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f9a2403dce0 msgr2=0x7f9a240401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:41.553 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.548+0000 7f9a50c2d640 1 --2- 10.20.193.52:0/1971662820 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f9a2403dce0 0x7f9a240401a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a340099c0 tx=0x7f9a34006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:41.553 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.548+0000 7f9a50c2d640 1 -- 10.20.193.52:0/1971662820 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9a4c1046d0 msgr2=0x7f9a4c19b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:41.553 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.548+0000 7f9a50c2d640 1 --2- 10.20.193.52:0/1971662820 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9a4c1046d0 0x7f9a4c19b2b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005ec0 tx=0x7f9a40004290 comp rx=0 tx=0).stop 2026-02-24T18:18:41.553 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.549+0000 7f9a50c2d640 1 -- 10.20.193.52:0/1971662820 shutdown_connections 2026-02-24T18:18:41.553 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.549+0000 7f9a50c2d640 1 --2- 10.20.193.52:0/1971662820 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f9a2403dce0 0x7f9a240401a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:41.553 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.549+0000 7f9a50c2d640 1 --2- 10.20.193.52:0/1971662820 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f9a4c1046d0 0x7f9a4c19b2b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:41.553 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.549+0000 7f9a50c2d640 1 -- 10.20.193.52:0/1971662820 >> 10.20.193.52:0/1971662820 conn(0x7f9a4c0ffe60 msgr2=0x7f9a4c100950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:41.554 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.549+0000 7f9a50c2d640 1 -- 10.20.193.52:0/1971662820 shutdown_connections 2026-02-24T18:18:41.554 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:41.549+0000 7f9a50c2d640 1 -- 10.20.193.52:0/1971662820 wait complete. 2026-02-24T18:18:41.587 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":16,"num_osds":3,"num_up_osds":2,"osd_up_since":1771957112,"num_in_osds":3,"osd_in_since":1771957107,"num_remapped_pgs":0} 2026-02-24T18:18:41.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:41 trial052 ceph-mon[39446]: from='osd.2 [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-24T18:18:42.588 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T18:18:42.738 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:42.758 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-2[63533]: 2026-02-24T18:18:42.500+0000 7f79755ff640 -1 osd.2 0 waiting for initial osdmap 2026-02-24T18:18:42.759 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:42 trial052 ceph-08cedbc6-11ad-11f1-a33f-d404e6e7d460-osd-2[63533]: 2026-02-24T18:18:42.503+0000 7f796d432640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T18:18:42.759 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:42 trial052 ceph-mon[39446]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T18:18:42.759 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:42 trial052 ceph-mon[39446]: from='osd.2 [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T18:18:42.759 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:42 trial052 ceph-mon[39446]: osdmap e16: 3 total, 2 up, 3 in 2026-02-24T18:18:42.759 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:42 trial052 ceph-mon[39446]: from='osd.2 [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial052", "root=default"]}]: dispatch 2026-02-24T18:18:42.759 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:42 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-24T18:18:42.759 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:42 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1971662820' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-24T18:18:42.836 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 -- 10.20.193.52:0/561562401 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3f701046a0 msgr2=0x7f3f70104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:42.836 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 --2- 10.20.193.52:0/561562401 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3f701046a0 0x7f3f70104aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f600099b0 tx=0x7f3f6002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:42.836 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 -- 10.20.193.52:0/561562401 shutdown_connections 2026-02-24T18:18:42.836 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 --2- 10.20.193.52:0/561562401 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3f701046a0 0x7f3f70104aa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:42.836 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 -- 10.20.193.52:0/561562401 >> 10.20.193.52:0/561562401 conn(0x7f3f700ffe30 msgr2=0x7f3f70102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 -- 10.20.193.52:0/561562401 shutdown_connections 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 -- 10.20.193.52:0/561562401 wait complete. 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 Processor -- start 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 -- start start 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3f701046a0 0x7f3f7019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f78014640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3f70109b20 con 0x7f3f701046a0 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.831+0000 7f3f75d89640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3f701046a0 0x7f3f7019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.832+0000 7f3f75d89640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3f701046a0 0x7f3f7019b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:52944/0 (socket says 10.20.193.52:52944) 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.832+0000 7f3f75d89640 1 -- 10.20.193.52:0/348310773 learned_addr learned my addr 10.20.193.52:0/348310773 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.832+0000 7f3f75d89640 1 -- 10.20.193.52:0/348310773 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7019b800 con 0x7f3f701046a0 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.832+0000 7f3f75d89640 1 --2- 10.20.193.52:0/348310773 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3f701046a0 0x7f3f7019b2c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f60005ec0 tx=0x7f3f60004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.832+0000 7f3f5effd640 1 -- 10.20.193.52:0/348310773 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f60038510 con 0x7f3f701046a0 2026-02-24T18:18:42.837 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.832+0000 7f3f5effd640 1 -- 10.20.193.52:0/348310773 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3f60046070 con 0x7f3f701046a0 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.832+0000 7f3f78014640 1 -- 10.20.193.52:0/348310773 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7019ba90 con 0x7f3f701046a0 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.832+0000 7f3f5effd640 1 -- 10.20.193.52:0/348310773 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f60041810 con 0x7f3f701046a0 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.832+0000 7f3f78014640 1 -- 10.20.193.52:0/348310773 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7019e780 con 0x7f3f701046a0 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.832+0000 7f3f78014640 1 -- 10.20.193.52:0/348310773 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7010a2c0 con 0x7f3f701046a0 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.833+0000 7f3f5effd640 1 -- 10.20.193.52:0/348310773 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f3f600386b0 con 0x7f3f701046a0 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.833+0000 7f3f5effd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.833+0000 7f3f5effd640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.833+0000 7f3f5effd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.833+0000 7f3f5effd640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.833+0000 7f3f5effd640 1 --2- 10.20.193.52:0/348310773 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3f4c03dce0 0x7f3f4c0401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.833+0000 7f3f5effd640 1 -- 10.20.193.52:0/348310773 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2349+0+0 (secure 0 0 0) 0x7f3f60077510 con 0x7f3f701046a0 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.833+0000 7f3f75588640 1 --2- 10.20.193.52:0/348310773 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3f4c03dce0 0x7f3f4c0401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:42.838 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.833+0000 7f3f75588640 1 --2- 10.20.193.52:0/348310773 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3f4c03dce0 0x7f3f4c0401a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3f640099c0 tx=0x7f3f64006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:42.839 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.835+0000 7f3f5effd640 1 -- 10.20.193.52:0/348310773 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3f600389d0 con 0x7f3f701046a0 2026-02-24T18:18:42.923 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.919+0000 7f3f78014640 1 -- 10.20.193.52:0/348310773 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3f70194880 con 0x7f3f701046a0 2026-02-24T18:18:42.923 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.920+0000 7f3f5effd640 1 -- 10.20.193.52:0/348310773 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v17) ==== 74+0+130 (secure 0 0 0) 0x7f3f6004a3c0 con 0x7f3f701046a0 2026-02-24T18:18:42.923 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:42.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 10 mgrc shutdown 2026-02-24T18:18:42.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 1 -- 10.20.193.52:0/348310773 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3f4c03dce0 msgr2=0x7f3f4c0401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:42.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 1 --2- 10.20.193.52:0/348310773 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3f4c03dce0 0x7f3f4c0401a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3f640099c0 tx=0x7f3f64006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:42.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 1 -- 10.20.193.52:0/348310773 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3f701046a0 msgr2=0x7f3f7019b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:42.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 1 --2- 10.20.193.52:0/348310773 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3f701046a0 0x7f3f7019b2c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f60005ec0 tx=0x7f3f60004290 comp rx=0 tx=0).stop 2026-02-24T18:18:42.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 1 -- 10.20.193.52:0/348310773 shutdown_connections 2026-02-24T18:18:42.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 1 --2- 10.20.193.52:0/348310773 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f3f4c03dce0 0x7f3f4c0401a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:42.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 1 --2- 10.20.193.52:0/348310773 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f3f701046a0 0x7f3f7019b2c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:42.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 1 -- 10.20.193.52:0/348310773 >> 10.20.193.52:0/348310773 conn(0x7f3f700ffe30 msgr2=0x7f3f701004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:42.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 1 -- 10.20.193.52:0/348310773 shutdown_connections 2026-02-24T18:18:42.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:42.921+0000 7f3f78014640 1 -- 10.20.193.52:0/348310773 wait complete. 2026-02-24T18:18:42.958 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":17,"num_osds":3,"num_up_osds":2,"osd_up_since":1771957112,"num_in_osds":3,"osd_in_since":1771957107,"num_remapped_pgs":0} 2026-02-24T18:18:43.959 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T18:18:43.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:43 trial052 ceph-mon[39446]: from='osd.2 [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial052", "root=default"]}]': finished 2026-02-24T18:18:43.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:43 trial052 ceph-mon[39446]: osdmap e17: 3 total, 2 up, 3 in 2026-02-24T18:18:43.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:43 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-24T18:18:43.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:43 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-24T18:18:43.965 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:43 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/348310773' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-24T18:18:44.118 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:44.221 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.216+0000 7fa9b477c640 1 -- 10.20.193.52:0/510519018 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac0770a0 msgr2=0x7fa9ac075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:44.221 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.216+0000 7fa9b477c640 1 --2- 10.20.193.52:0/510519018 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac0770a0 0x7fa9ac075500 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0099b0 tx=0x7fa99c02f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.221 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.216+0000 7fa9b477c640 1 -- 10.20.193.52:0/510519018 shutdown_connections 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.216+0000 7fa9b477c640 1 --2- 10.20.193.52:0/510519018 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac0770a0 0x7fa9ac075500 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.216+0000 7fa9b477c640 1 -- 10.20.193.52:0/510519018 >> 10.20.193.52:0/510519018 conn(0x7fa9ac0fdbb0 msgr2=0x7fa9ac0ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.216+0000 7fa9b477c640 1 -- 10.20.193.52:0/510519018 shutdown_connections 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.216+0000 7fa9b477c640 1 -- 10.20.193.52:0/510519018 wait complete. 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.216+0000 7fa9b477c640 1 Processor -- start 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.216+0000 7fa9b477c640 1 -- start start 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9b477c640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac0770a0 0x7fa9ac19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9b477c640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac1055f0 con 0x7fa9ac0770a0 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9b24f1640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac0770a0 0x7fa9ac19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9b24f1640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac0770a0 0x7fa9ac19f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:52966/0 (socket says 10.20.193.52:52966) 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9b24f1640 1 -- 10.20.193.52:0/2863596989 learned_addr learned my addr 10.20.193.52:0/2863596989 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9b24f1640 1 -- 10.20.193.52:0/2863596989 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ac19fcf0 con 0x7fa9ac0770a0 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9b24f1640 1 --2- 10.20.193.52:0/2863596989 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac0770a0 0x7fa9ac19f7b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009ae0 tx=0x7fa99c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9937fe640 1 -- 10.20.193.52:0/2863596989 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99c038640 con 0x7fa9ac0770a0 2026-02-24T18:18:44.222 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9937fe640 1 -- 10.20.193.52:0/2863596989 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa99c046070 con 0x7fa9ac0770a0 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9b477c640 1 -- 10.20.193.52:0/2863596989 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ac19ff80 con 0x7fa9ac0770a0 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9937fe640 1 -- 10.20.193.52:0/2863596989 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99c041870 con 0x7fa9ac0770a0 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9b477c640 1 -- 10.20.193.52:0/2863596989 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ac1a2c70 con 0x7fa9ac0770a0 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9b477c640 1 -- 10.20.193.52:0/2863596989 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ac105d90 con 0x7fa9ac0770a0 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9937fe640 1 -- 10.20.193.52:0/2863596989 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fa99c0387e0 con 0x7fa9ac0770a0 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.217+0000 7fa9937fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.218+0000 7fa9937fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.218+0000 7fa9937fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.218+0000 7fa9937fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.218+0000 7fa9937fe640 1 --2- 10.20.193.52:0/2863596989 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa98803dc90 0x7fa988040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.218+0000 7fa9937fe640 1 -- 10.20.193.52:0/2863596989 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2629+0+0 (secure 0 0 0) 0x7fa99c077800 con 0x7fa9ac0770a0 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.218+0000 7fa9b1cf0640 1 --2- 10.20.193.52:0/2863596989 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa98803dc90 0x7fa988040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:44.223 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.218+0000 7fa9b1cf0640 1 --2- 10.20.193.52:0/2863596989 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa98803dc90 0x7fa988040150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00099c0 tx=0x7fa9a0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:44.224 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.220+0000 7fa9937fe640 1 -- 10.20.193.52:0/2863596989 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa99c040360 con 0x7fa9ac0770a0 2026-02-24T18:18:44.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.302+0000 7fa9b477c640 1 -- 10.20.193.52:0/2863596989 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa9ac198d60 con 0x7fa9ac0770a0 2026-02-24T18:18:44.305 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.302+0000 7fa9937fe640 1 -- 10.20.193.52:0/2863596989 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v18) ==== 74+0+130 (secure 0 0 0) 0x7fa99c049360 con 0x7fa9ac0770a0 2026-02-24T18:18:44.305 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:44.306 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 10 mgrc shutdown 2026-02-24T18:18:44.306 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 1 -- 10.20.193.52:0/2863596989 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa98803dc90 msgr2=0x7fa988040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:44.306 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 1 --2- 10.20.193.52:0/2863596989 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa98803dc90 0x7fa988040150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00099c0 tx=0x7fa9a0006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.306 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 1 -- 10.20.193.52:0/2863596989 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac0770a0 msgr2=0x7fa9ac19f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:44.306 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 1 --2- 10.20.193.52:0/2863596989 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac0770a0 0x7fa9ac19f7b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009ae0 tx=0x7fa99c004290 comp rx=0 tx=0).stop 2026-02-24T18:18:44.306 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 1 -- 10.20.193.52:0/2863596989 shutdown_connections 2026-02-24T18:18:44.306 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 1 --2- 10.20.193.52:0/2863596989 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa98803dc90 0x7fa988040150 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.307 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 1 --2- 10.20.193.52:0/2863596989 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa9ac0770a0 0x7fa9ac19f7b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.307 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 1 -- 10.20.193.52:0/2863596989 >> 10.20.193.52:0/2863596989 conn(0x7fa9ac0fdbb0 msgr2=0x7fa9ac0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:44.307 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 1 -- 10.20.193.52:0/2863596989 shutdown_connections 2026-02-24T18:18:44.307 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.303+0000 7fa9b477c640 1 -- 10.20.193.52:0/2863596989 wait complete. 2026-02-24T18:18:44.339 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":18,"num_osds":3,"num_up_osds":3,"osd_up_since":1771957123,"num_in_osds":3,"osd_in_since":1771957107,"num_remapped_pgs":0} 2026-02-24T18:18:44.339 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T18:18:44.485 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:44.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.588+0000 7f3377e8c640 1 -- 10.20.193.52:0/1493253074 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f337010a650 msgr2=0x7f337010aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:44.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.588+0000 7f3377e8c640 1 --2- 10.20.193.52:0/1493253074 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f337010a650 0x7f337010aa30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f33600099b0 tx=0x7f336002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.588+0000 7f3377e8c640 1 -- 10.20.193.52:0/1493253074 shutdown_connections 2026-02-24T18:18:44.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.588+0000 7f3377e8c640 1 --2- 10.20.193.52:0/1493253074 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f337010a650 0x7f337010aa30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.588+0000 7f3377e8c640 1 -- 10.20.193.52:0/1493253074 >> 10.20.193.52:0/1493253074 conn(0x7f3370100330 msgr2=0x7f3370102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:44.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.588+0000 7f3377e8c640 1 -- 10.20.193.52:0/1493253074 shutdown_connections 2026-02-24T18:18:44.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.588+0000 7f3377e8c640 1 -- 10.20.193.52:0/1493253074 wait complete. 2026-02-24T18:18:44.593 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:44 trial052 ceph-mon[39446]: purged_snaps scrub starts 2026-02-24T18:18:44.593 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:44 trial052 ceph-mon[39446]: purged_snaps scrub ok 2026-02-24T18:18:44.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:44 trial052 ceph-mon[39446]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T18:18:44.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:44 trial052 ceph-mon[39446]: osd.2 [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604] boot 2026-02-24T18:18:44.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:44 trial052 ceph-mon[39446]: osdmap e18: 3 total, 3 up, 3 in 2026-02-24T18:18:44.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:44 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-24T18:18:44.594 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:44 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2863596989' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-24T18:18:44.596 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3377e8c640 1 Processor -- start 2026-02-24T18:18:44.596 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3377e8c640 1 -- start start 2026-02-24T18:18:44.596 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3377e8c640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f337010a650 0x7f337019b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:44.596 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3377e8c640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f337010e060 con 0x7f337010a650 2026-02-24T18:18:44.596 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3375c01640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f337010a650 0x7f337019b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:44.596 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3375c01640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f337010a650 0x7f337019b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:52978/0 (socket says 10.20.193.52:52978) 2026-02-24T18:18:44.596 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3375c01640 1 -- 10.20.193.52:0/1261180962 learned_addr learned my addr 10.20.193.52:0/1261180962 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:44.596 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3375c01640 1 -- 10.20.193.52:0/1261180962 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337019bb70 con 0x7f337010a650 2026-02-24T18:18:44.596 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3375c01640 1 --2- 10.20.193.52:0/1261180962 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f337010a650 0x7f337019b630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3360004290 tx=0x7f33600042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f335effd640 1 -- 10.20.193.52:0/1261180962 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3360038510 con 0x7f337010a650 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f335effd640 1 -- 10.20.193.52:0/1261180962 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3360046070 con 0x7f337010a650 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3377e8c640 1 -- 10.20.193.52:0/1261180962 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337019be00 con 0x7f337010a650 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f335effd640 1 -- 10.20.193.52:0/1261180962 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3360041610 con 0x7f337010a650 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.589+0000 7f3377e8c640 1 -- 10.20.193.52:0/1261180962 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337019ff00 con 0x7f337010a650 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.590+0000 7f3377e8c640 1 -- 10.20.193.52:0/1261180962 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3370105d90 con 0x7f337010a650 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.590+0000 7f335effd640 1 -- 10.20.193.52:0/1261180962 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f33600386b0 con 0x7f337010a650 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.590+0000 7f335effd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.590+0000 7f335effd640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.590+0000 7f335effd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.590+0000 7f335effd640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.590+0000 7f335effd640 1 --2- 10.20.193.52:0/1261180962 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f334c03dc90 0x7f334c040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.590+0000 7f335effd640 1 -- 10.20.193.52:0/1261180962 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2629+0+0 (secure 0 0 0) 0x7f3360077660 con 0x7f337010a650 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.590+0000 7f3375400640 1 --2- 10.20.193.52:0/1261180962 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f334c03dc90 0x7f334c040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.590+0000 7f3375400640 1 --2- 10.20.193.52:0/1261180962 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f334c03dc90 0x7f334c040150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f33640099c0 tx=0x7f3364006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:44.597 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.593+0000 7f335effd640 1 -- 10.20.193.52:0/1261180962 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3360040360 con 0x7f337010a650 2026-02-24T18:18:44.680 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.677+0000 7f3377e8c640 1 -- 10.20.193.52:0/1261180962 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f337010aab0 con 0x7f337010a650 2026-02-24T18:18:44.680 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.678+0000 7f335effd640 1 -- 10.20.193.52:0/1261180962 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+5546 (secure 0 0 0) 0x7f3360049360 con 0x7f337010a650 2026-02-24T18:18:44.680 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:44.680 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":19,"fsid":"08cedbc6-11ad-11f1-a33f-d404e6e7d460","created":"2026-02-24T18:17:34.352867+0000","modified":"2026-02-24T18:18:44.503847+0000","last_up_change":"2026-02-24T18:18:43.499514+0000","last_in_change":"2026-02-24T18:18:27.156353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c9f4f18e-df8e-4e3b-8e5f-88c26770f5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6802","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6803","nonce":3519871937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6804","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6805","nonce":3519871937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6808","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6809","nonce":3519871937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6806","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6807","nonce":3519871937}]},"public_addr":"10.20.193.52:6803/3519871937","cluster_addr":"10.20.193.52:6805/3519871937","heartbeat_back_addr":"10.20.193.52:6809/3519871937","heartbeat_front_addr":"10.20.193.52:6807/3519871937","state":["exists","up"]},{"osd":1,"uuid":"4333ab0f-7dc0-4585-8888-50d9eee9be76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6810","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6811","nonce":1866424205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6812","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6813","nonce":1866424205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6816","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6817","nonce":1866424205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6814","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6815","nonce":1866424205}]},"public_addr":"10.20.193.52:6811/1866424205","cluster_addr":"10.20.193.52:6813/1866424205","heartbeat_back_addr":"10.20.193.52:6817/1866424205","heartbeat_front_addr":"10.20.193.52:6815/1866424205","state":["exists","up"]},{"osd":2,"uuid":"2595bd04-35f8-4296-b0be-313e8f0305c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6818","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6819","nonce":97806604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6820","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6821","nonce":97806604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6824","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6825","nonce":97806604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6822","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6823","nonce":97806604}]},"public_addr":"10.20.193.52:6819/97806604","cluster_addr":"10.20.193.52:6821/97806604","heartbeat_back_addr":"10.20.193.52:6825/97806604","heartbeat_front_addr":"10.20.193.52:6823/97806604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T18:18:20.185746+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T18:18:31.205174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T18:18:42.121811+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.52:0/105634038":"2026-02-25T18:17:53.140268+0000","10.20.193.52:6801/3088300703":"2026-02-25T18:17:53.140268+0000","10.20.193.52:6800/3088300703":"2026-02-25T18:17:53.140268+0000","10.20.193.52:0/3643231119":"2026-02-25T18:17:53.140268+0000","10.20.193.52:0/1206891036":"2026-02-25T18:17:53.140268+0000","10.20.193.52:0/885680259":"2026-02-25T18:17:44.181278+0000","10.20.193.52:0/2040469486":"2026-02-25T18:17:44.181278+0000","10.20.193.52:6801/4278953045":"2026-02-25T18:17:44.181278+0000","10.20.193.52:6800/4278953045":"2026-02-25T18:17:44.181278+0000","10.20.193.52:0/1211468346":"2026-02-25T18:17:44.181278+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 10 mgrc shutdown 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 1 -- 10.20.193.52:0/1261180962 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f334c03dc90 msgr2=0x7f334c040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 1 --2- 10.20.193.52:0/1261180962 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f334c03dc90 0x7f334c040150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f33640099c0 tx=0x7f3364006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 1 -- 10.20.193.52:0/1261180962 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f337010a650 msgr2=0x7f337019b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 1 --2- 10.20.193.52:0/1261180962 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f337010a650 0x7f337019b630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3360004290 tx=0x7f33600042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 1 -- 10.20.193.52:0/1261180962 shutdown_connections 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 1 --2- 10.20.193.52:0/1261180962 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f334c03dc90 0x7f334c040150 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 1 --2- 10.20.193.52:0/1261180962 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f337010a650 0x7f337019b630 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 1 -- 10.20.193.52:0/1261180962 >> 10.20.193.52:0/1261180962 conn(0x7f3370100330 msgr2=0x7f3370108830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 1 -- 10.20.193.52:0/1261180962 shutdown_connections 2026-02-24T18:18:44.681 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.679+0000 7f3377e8c640 1 -- 10.20.193.52:0/1261180962 wait complete. 2026-02-24T18:18:44.716 INFO:tasks.cephadm.ceph_manager.ceph:[] 2026-02-24T18:18:44.716 INFO:tasks.cephadm:Setting up client nodes... 2026-02-24T18:18:44.716 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-24T18:18:44.865 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:44.970 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.965+0000 7f75b4051640 1 -- 10.20.193.52:0/798633711 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ac1046a0 msgr2=0x7f75ac104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:44.970 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.965+0000 7f75b4051640 1 --2- 10.20.193.52:0/798633711 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ac1046a0 0x7f75ac104aa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f759c0099b0 tx=0x7f759c02f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.970 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.965+0000 7f75b4051640 1 -- 10.20.193.52:0/798633711 shutdown_connections 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.965+0000 7f75b4051640 1 --2- 10.20.193.52:0/798633711 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ac1046a0 0x7f75ac104aa0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.965+0000 7f75b4051640 1 -- 10.20.193.52:0/798633711 >> 10.20.193.52:0/798633711 conn(0x7f75ac0ffe30 msgr2=0x7f75ac102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.965+0000 7f75b4051640 1 -- 10.20.193.52:0/798633711 shutdown_connections 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.965+0000 7f75b4051640 1 -- 10.20.193.52:0/798633711 wait complete. 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b4051640 1 Processor -- start 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b4051640 1 -- start start 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b4051640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ac1046a0 0x7f75ac19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b4051640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac109b20 con 0x7f75ac1046a0 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b1dc6640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ac1046a0 0x7f75ac19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b1dc6640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ac1046a0 0x7f75ac19b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:53006/0 (socket says 10.20.193.52:53006) 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b1dc6640 1 -- 10.20.193.52:0/1584721479 learned_addr learned my addr 10.20.193.52:0/1584721479 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b1dc6640 1 -- 10.20.193.52:0/1584721479 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac19b820 con 0x7f75ac1046a0 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b1dc6640 1 --2- 10.20.193.52:0/1584721479 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ac1046a0 0x7f75ac19b2e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f759c005ec0 tx=0x7f759c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:44.971 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f759affd640 1 -- 10.20.193.52:0/1584721479 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f759c038510 con 0x7f75ac1046a0 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f759affd640 1 -- 10.20.193.52:0/1584721479 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f759c046070 con 0x7f75ac1046a0 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f759affd640 1 -- 10.20.193.52:0/1584721479 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f759c041730 con 0x7f75ac1046a0 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b4051640 1 -- 10.20.193.52:0/1584721479 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac19bab0 con 0x7f75ac1046a0 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.966+0000 7f75b4051640 1 -- 10.20.193.52:0/1584721479 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ac19e7a0 con 0x7f75ac1046a0 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.967+0000 7f75b4051640 1 -- 10.20.193.52:0/1584721479 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ac10a2c0 con 0x7f75ac1046a0 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.967+0000 7f759affd640 1 -- 10.20.193.52:0/1584721479 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f759c0386b0 con 0x7f75ac1046a0 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.967+0000 7f759affd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.967+0000 7f759affd640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.967+0000 7f759affd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.967+0000 7f759affd640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.967+0000 7f759affd640 1 --2- 10.20.193.52:0/1584721479 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f758803dc90 0x7f7588040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.967+0000 7f759affd640 1 -- 10.20.193.52:0/1584721479 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2629+0+0 (secure 0 0 0) 0x7f759c077600 con 0x7f75ac1046a0 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.967+0000 7f75b15c5640 1 --2- 10.20.193.52:0/1584721479 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f758803dc90 0x7f7588040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:44.972 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.967+0000 7f75b15c5640 1 --2- 10.20.193.52:0/1584721479 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f758803dc90 0x7f7588040150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75a00099c0 tx=0x7f75a0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:44.973 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:44.969+0000 7f759affd640 1 -- 10.20.193.52:0/1584721479 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f759c050020 con 0x7f75ac1046a0 2026-02-24T18:18:45.085 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.082+0000 7f75b4051640 1 -- 10.20.193.52:0/1584721479 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f75ac1948b0 con 0x7f75ac1046a0 2026-02-24T18:18:45.086 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.083+0000 7f759affd640 1 -- 10.20.193.52:0/1584721479 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v7) ==== 170+0+59 (secure 0 0 0) 0x7f759c04bdb0 con 0x7f75ac1046a0 2026-02-24T18:18:45.086 INFO:teuthology.orchestra.run.trial052.stdout:[client.0] 2026-02-24T18:18:45.086 INFO:teuthology.orchestra.run.trial052.stdout: key = AQCF651pafIFBRAA+oVcuQzbNVZabGHSdO8PWA== 2026-02-24T18:18:45.086 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 10 mgrc shutdown 2026-02-24T18:18:45.086 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 1 -- 10.20.193.52:0/1584721479 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f758803dc90 msgr2=0x7f7588040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:45.087 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 1 --2- 10.20.193.52:0/1584721479 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f758803dc90 0x7f7588040150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75a00099c0 tx=0x7f75a0006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:45.087 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 1 -- 10.20.193.52:0/1584721479 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ac1046a0 msgr2=0x7f75ac19b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:45.087 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 1 --2- 10.20.193.52:0/1584721479 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ac1046a0 0x7f75ac19b2e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f759c005ec0 tx=0x7f759c004290 comp rx=0 tx=0).stop 2026-02-24T18:18:45.087 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 1 -- 10.20.193.52:0/1584721479 shutdown_connections 2026-02-24T18:18:45.087 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 1 --2- 10.20.193.52:0/1584721479 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f758803dc90 0x7f7588040150 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:45.087 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 1 --2- 10.20.193.52:0/1584721479 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f75ac1046a0 0x7f75ac19b2e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:45.087 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 1 -- 10.20.193.52:0/1584721479 >> 10.20.193.52:0/1584721479 conn(0x7f75ac0ffe30 msgr2=0x7f75ac1004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:45.087 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 1 -- 10.20.193.52:0/1584721479 shutdown_connections 2026-02-24T18:18:45.087 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.084+0000 7f75b4051640 1 -- 10.20.193.52:0/1584721479 wait complete. 2026-02-24T18:18:45.123 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:18:45.123 DEBUG:teuthology.orchestra.run.trial052:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-24T18:18:45.123 DEBUG:teuthology.orchestra.run.trial052:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T18:18:45.157 DEBUG:teuthology.orchestra.run.trial080:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-24T18:18:45.300 INFO:teuthology.orchestra.run.trial080.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/config/ceph.conf 2026-02-24T18:18:45.449 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.444+0000 7f538e7fc640 1 -- 10.20.193.80:0/3976352530 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f537c002d10 con 0x7f53900770a0 2026-02-24T18:18:45.449 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.444+0000 7f5395cd8640 1 -- 10.20.193.80:0/3976352530 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f53900770a0 msgr2=0x7f5390075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:45.449 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.444+0000 7f5395cd8640 1 --2- 10.20.193.80:0/3976352530 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f53900770a0 0x7f5390075500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f537c0099b0 tx=0x7f537c02f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:45.449 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.444+0000 7f5395cd8640 1 -- 10.20.193.80:0/3976352530 shutdown_connections 2026-02-24T18:18:45.450 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.444+0000 7f5395cd8640 1 --2- 10.20.193.80:0/3976352530 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f53900770a0 0x7f5390075500 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:45.450 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.444+0000 7f5395cd8640 1 -- 10.20.193.80:0/3976352530 >> 10.20.193.80:0/3976352530 conn(0x7f53900fdac0 msgr2=0x7f53900fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:45.450 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.444+0000 7f5395cd8640 1 -- 10.20.193.80:0/3976352530 shutdown_connections 2026-02-24T18:18:45.450 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.444+0000 7f5395cd8640 1 -- 10.20.193.80:0/3976352530 wait complete. 2026-02-24T18:18:45.450 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.445+0000 7f5395cd8640 1 Processor -- start 2026-02-24T18:18:45.450 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.445+0000 7f5395cd8640 1 -- start start 2026-02-24T18:18:45.450 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.445+0000 7f5395cd8640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f53900770a0 0x7f539019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:45.450 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.445+0000 7f5395cd8640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5390109a10 con 0x7f53900770a0 2026-02-24T18:18:45.450 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.445+0000 7f538f7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f53900770a0 0x7f539019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:45.450 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.445+0000 7f538f7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f53900770a0 0x7f539019b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.80:32962/0 (socket says 10.20.193.80:32962) 2026-02-24T18:18:45.451 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.445+0000 7f538f7fe640 1 -- 10.20.193.80:0/2042311672 learned_addr learned my addr 10.20.193.80:0/2042311672 (peer_addr_for_me v2:10.20.193.80:0/0) 2026-02-24T18:18:45.451 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.445+0000 7f538f7fe640 1 -- 10.20.193.80:0/2042311672 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539019b670 con 0x7f53900770a0 2026-02-24T18:18:45.451 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.446+0000 7f538f7fe640 1 --2- 10.20.193.80:0/2042311672 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f53900770a0 0x7f539019b130 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f537c009ae0 tx=0x7f537c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:45.451 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.446+0000 7f538cff9640 1 -- 10.20.193.80:0/2042311672 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f537c038640 con 0x7f53900770a0 2026-02-24T18:18:45.451 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.446+0000 7f538cff9640 1 -- 10.20.193.80:0/2042311672 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f537c046070 con 0x7f53900770a0 2026-02-24T18:18:45.451 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.446+0000 7f5395cd8640 1 -- 10.20.193.80:0/2042311672 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539019b900 con 0x7f53900770a0 2026-02-24T18:18:45.451 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.446+0000 7f5395cd8640 1 -- 10.20.193.80:0/2042311672 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539019e5f0 con 0x7f53900770a0 2026-02-24T18:18:45.451 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.446+0000 7f538cff9640 1 -- 10.20.193.80:0/2042311672 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f537c041860 con 0x7f53900770a0 2026-02-24T18:18:45.451 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.446+0000 7f5395cd8640 1 -- 10.20.193.80:0/2042311672 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f539010a1b0 con 0x7f53900770a0 2026-02-24T18:18:45.452 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.447+0000 7f538cff9640 1 -- 10.20.193.80:0/2042311672 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f537c0387e0 con 0x7f53900770a0 2026-02-24T18:18:45.452 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.447+0000 7f538cff9640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:45.453 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.447+0000 7f538cff9640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:45.453 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.447+0000 7f538cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:45.453 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.447+0000 7f538cff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:45.453 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.447+0000 7f538cff9640 1 --2- 10.20.193.80:0/2042311672 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f536403dc90 0x7f5364040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:45.453 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.447+0000 7f538cff9640 1 -- 10.20.193.80:0/2042311672 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2629+0+0 (secure 0 0 0) 0x7f537c0780b0 con 0x7f53900770a0 2026-02-24T18:18:45.453 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.447+0000 7f538effd640 1 --2- 10.20.193.80:0/2042311672 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f536403dc90 0x7f5364040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:45.453 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.448+0000 7f538effd640 1 --2- 10.20.193.80:0/2042311672 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f536403dc90 0x7f5364040150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53800099c0 tx=0x7f5380006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:45.453 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.450+0000 7f538cff9640 1 -- 10.20.193.80:0/2042311672 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f537c050200 con 0x7f53900770a0 2026-02-24T18:18:45.569 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.566+0000 7f5395cd8640 1 -- 10.20.193.80:0/2042311672 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f5390194770 con 0x7f53900770a0 2026-02-24T18:18:45.570 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.567+0000 7f538cff9640 1 -- 10.20.193.80:0/2042311672 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v8) ==== 170+0+59 (secure 0 0 0) 0x7f537c051d40 con 0x7f53900770a0 2026-02-24T18:18:45.570 INFO:teuthology.orchestra.run.trial080.stdout:[client.1] 2026-02-24T18:18:45.571 INFO:teuthology.orchestra.run.trial080.stdout: key = AQCF651pzHjbIRAABPvdZyKPz7mptYPP1tIyUA== 2026-02-24T18:18:45.572 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 10 mgrc shutdown 2026-02-24T18:18:45.572 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 1 -- 10.20.193.80:0/2042311672 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f536403dc90 msgr2=0x7f5364040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:45.572 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 1 --2- 10.20.193.80:0/2042311672 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f536403dc90 0x7f5364040150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53800099c0 tx=0x7f5380006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:45.572 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 1 -- 10.20.193.80:0/2042311672 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f53900770a0 msgr2=0x7f539019b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:45.572 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 1 --2- 10.20.193.80:0/2042311672 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f53900770a0 0x7f539019b130 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f537c009ae0 tx=0x7f537c004290 comp rx=0 tx=0).stop 2026-02-24T18:18:45.572 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 1 -- 10.20.193.80:0/2042311672 shutdown_connections 2026-02-24T18:18:45.572 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 1 --2- 10.20.193.80:0/2042311672 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f536403dc90 0x7f5364040150 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:45.572 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 1 --2- 10.20.193.80:0/2042311672 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f53900770a0 0x7f539019b130 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:45.573 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 1 -- 10.20.193.80:0/2042311672 >> 10.20.193.80:0/2042311672 conn(0x7f53900fdac0 msgr2=0x7f53900fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:45.573 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 1 -- 10.20.193.80:0/2042311672 shutdown_connections 2026-02-24T18:18:45.573 INFO:teuthology.orchestra.run.trial080.stderr:2026-02-24T18:18:45.568+0000 7f5395cd8640 1 -- 10.20.193.80:0/2042311672 wait complete. 2026-02-24T18:18:45.606 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:18:45.606 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-24T18:18:45.606 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-24T18:18:45.699 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T18:18:45.699 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-24T18:18:45.700 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-24T18:18:45.848 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:45.868 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:45 trial052 ceph-mon[39446]: osdmap e19: 3 total, 3 up, 3 in 2026-02-24T18:18:45.868 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:45 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1261180962' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-24T18:18:45.868 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:45 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1584721479' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-24T18:18:45.868 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:45 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1584721479' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T18:18:45.868 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:45 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-24T18:18:45.950 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.945+0000 7f05ac5d6640 1 -- 10.20.193.52:0/1575087274 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f05a410a650 msgr2=0x7f05a410aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:45.950 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.945+0000 7f05ac5d6640 1 --2- 10.20.193.52:0/1575087274 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f05a410a650 0x7f05a410aa30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f05940099b0 tx=0x7f059402f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.945+0000 7f05ac5d6640 1 -- 10.20.193.52:0/1575087274 shutdown_connections 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.945+0000 7f05ac5d6640 1 --2- 10.20.193.52:0/1575087274 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f05a410a650 0x7f05a410aa30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.945+0000 7f05ac5d6640 1 -- 10.20.193.52:0/1575087274 >> 10.20.193.52:0/1575087274 conn(0x7f05a4100330 msgr2=0x7f05a4102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.945+0000 7f05ac5d6640 1 -- 10.20.193.52:0/1575087274 shutdown_connections 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.945+0000 7f05ac5d6640 1 -- 10.20.193.52:0/1575087274 wait complete. 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05ac5d6640 1 Processor -- start 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05ac5d6640 1 -- start start 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05ac5d6640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f05a410a650 0x7f05a419b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05ac5d6640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410e060 con 0x7f05a410a650 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05aa34b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f05a410a650 0x7f05a419b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:45.951 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05aa34b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f05a410a650 0x7f05a419b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46566/0 (socket says 10.20.193.52:46566) 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05aa34b640 1 -- 10.20.193.52:0/3484151880 learned_addr learned my addr 10.20.193.52:0/3484151880 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05aa34b640 1 -- 10.20.193.52:0/3484151880 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a419bb70 con 0x7f05a410a650 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05aa34b640 1 --2- 10.20.193.52:0/3484151880 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f05a410a650 0x7f05a419b630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0594002410 tx=0x7f0594004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f058b7fe640 1 -- 10.20.193.52:0/3484151880 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0594038510 con 0x7f05a410a650 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f058b7fe640 1 -- 10.20.193.52:0/3484151880 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0594046070 con 0x7f05a410a650 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05ac5d6640 1 -- 10.20.193.52:0/3484151880 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a419be00 con 0x7f05a410a650 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f058b7fe640 1 -- 10.20.193.52:0/3484151880 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0594041630 con 0x7f05a410a650 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.946+0000 7f05ac5d6640 1 -- 10.20.193.52:0/3484151880 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a419ff00 con 0x7f05a410a650 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.947+0000 7f05ac5d6640 1 -- 10.20.193.52:0/3484151880 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a4105d90 con 0x7f05a410a650 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.947+0000 7f058b7fe640 1 -- 10.20.193.52:0/3484151880 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f05940386b0 con 0x7f05a410a650 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.947+0000 7f058b7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:45.952 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.947+0000 7f058b7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:45.953 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.947+0000 7f058b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:45.953 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.947+0000 7f058b7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:45.953 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.947+0000 7f058b7fe640 1 --2- 10.20.193.52:0/3484151880 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f058003dce0 0x7f05800401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:45.953 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.947+0000 7f058b7fe640 1 -- 10.20.193.52:0/3484151880 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2629+0+0 (secure 0 0 0) 0x7f0594077690 con 0x7f05a410a650 2026-02-24T18:18:45.953 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.947+0000 7f05a9b4a640 1 --2- 10.20.193.52:0/3484151880 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f058003dce0 0x7f05800401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:45.953 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.947+0000 7f05a9b4a640 1 --2- 10.20.193.52:0/3484151880 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f058003dce0 0x7f05800401a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f05980099c0 tx=0x7f0598006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:45.953 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:45.949+0000 7f058b7fe640 1 -- 10.20.193.52:0/3484151880 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0594007c50 con 0x7f05a410a650 2026-02-24T18:18:46.055 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.052+0000 7f05ac5d6640 1 -- 10.20.193.52:0/3484151880 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f05a410aab0 con 0x7f05a410a650 2026-02-24T18:18:46.056 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.053+0000 7f058b7fe640 1 -- 10.20.193.52:0/3484151880 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v13) ==== 74+0+96692 (secure 0 0 0) 0x7f05940389d0 con 0x7f05a410a650 2026-02-24T18:18:46.058 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:46.060 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 10 mgrc shutdown 2026-02-24T18:18:46.060 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 1 -- 10.20.193.52:0/3484151880 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f058003dce0 msgr2=0x7f05800401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:46.060 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 1 --2- 10.20.193.52:0/3484151880 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f058003dce0 0x7f05800401a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f05980099c0 tx=0x7f0598006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.060 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 1 -- 10.20.193.52:0/3484151880 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f05a410a650 msgr2=0x7f05a419b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:46.060 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 1 --2- 10.20.193.52:0/3484151880 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f05a410a650 0x7f05a419b630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0594002410 tx=0x7f0594004290 comp rx=0 tx=0).stop 2026-02-24T18:18:46.060 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 1 -- 10.20.193.52:0/3484151880 shutdown_connections 2026-02-24T18:18:46.060 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 1 --2- 10.20.193.52:0/3484151880 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f058003dce0 0x7f05800401a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.060 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 1 --2- 10.20.193.52:0/3484151880 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f05a410a650 0x7f05a419b630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.061 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 1 -- 10.20.193.52:0/3484151880 >> 10.20.193.52:0/3484151880 conn(0x7f05a4100330 msgr2=0x7f05a4108830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:46.061 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 1 -- 10.20.193.52:0/3484151880 shutdown_connections 2026-02-24T18:18:46.061 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.054+0000 7f05ac5d6640 1 -- 10.20.193.52:0/3484151880 wait complete. 2026-02-24T18:18:46.091 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":13,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6800","nonce":2288435215},{"type":"v1","addr":"10.20.193.52:6801","nonce":2288435215}]},"active_addr":"10.20.193.52:6801/2288435215","active_change":"2026-02-24T18:17:53.140360+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.52:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.52:0","nonce":2113276249}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.52:0","nonce":180815265}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.52:0","nonce":4265638936}]}]} 2026-02-24T18:18:46.095 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-24T18:18:46.096 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-24T18:18:46.096 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T18:18:46.241 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:46.347 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.344+0000 7f25c18e6640 1 -- 10.20.193.52:0/1864462193 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f25bc10d6f0 msgr2=0x7f25bc10dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:46.347 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.344+0000 7f25c18e6640 1 --2- 10.20.193.52:0/1864462193 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f25bc10d6f0 0x7f25bc10dad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f25b00099b0 tx=0x7f25b002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.347 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.344+0000 7f25c18e6640 1 -- 10.20.193.52:0/1864462193 shutdown_connections 2026-02-24T18:18:46.347 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.344+0000 7f25c18e6640 1 --2- 10.20.193.52:0/1864462193 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f25bc10d6f0 0x7f25bc10dad0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.347 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.344+0000 7f25c18e6640 1 -- 10.20.193.52:0/1864462193 >> 10.20.193.52:0/1864462193 conn(0x7f25bc06cd20 msgr2=0x7f25bc06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:46.347 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.344+0000 7f25c18e6640 1 -- 10.20.193.52:0/1864462193 shutdown_connections 2026-02-24T18:18:46.347 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.344+0000 7f25c18e6640 1 -- 10.20.193.52:0/1864462193 wait complete. 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25c18e6640 1 Processor -- start 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25c18e6640 1 -- start start 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25c18e6640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f25bc10d6f0 0x7f25bc1a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25c18e6640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc116a50 con 0x7f25bc10d6f0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25baffd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f25bc10d6f0 0x7f25bc1a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25baffd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f25bc10d6f0 0x7f25bc1a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46580/0 (socket says 10.20.193.52:46580) 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25baffd640 1 -- 10.20.193.52:0/3776371899 learned_addr learned my addr 10.20.193.52:0/3776371899 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25baffd640 1 -- 10.20.193.52:0/3776371899 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25bc1a45a0 con 0x7f25bc10d6f0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25baffd640 1 --2- 10.20.193.52:0/3776371899 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f25bc10d6f0 0x7f25bc1a4060 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f25b0004290 tx=0x7f25b00042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25c08e4640 1 -- 10.20.193.52:0/3776371899 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b0038510 con 0x7f25bc10d6f0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25c18e6640 1 -- 10.20.193.52:0/3776371899 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25bc1a4830 con 0x7f25bc10d6f0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25c08e4640 1 -- 10.20.193.52:0/3776371899 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f25b0046070 con 0x7f25bc10d6f0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25c08e4640 1 -- 10.20.193.52:0/3776371899 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b0041610 con 0x7f25bc10d6f0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.345+0000 7f25c18e6640 1 -- 10.20.193.52:0/3776371899 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25bc1a8930 con 0x7f25bc10d6f0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.346+0000 7f25c18e6640 1 -- 10.20.193.52:0/3776371899 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25bc10e770 con 0x7f25bc10d6f0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.346+0000 7f25c08e4640 1 -- 10.20.193.52:0/3776371899 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f25b0041910 con 0x7f25bc10d6f0 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.346+0000 7f25c08e4640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.346+0000 7f25c08e4640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.346+0000 7f25c08e4640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:46.348 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.346+0000 7f25c08e4640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:46.349 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.346+0000 7f25c08e4640 1 --2- 10.20.193.52:0/3776371899 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f259003dc90 0x7f2590040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:46.349 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.346+0000 7f25c08e4640 1 -- 10.20.193.52:0/3776371899 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3004+0+0 (secure 0 0 0) 0x7f25b0077970 con 0x7f25bc10d6f0 2026-02-24T18:18:46.349 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.346+0000 7f25ba7fc640 1 --2- 10.20.193.52:0/3776371899 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f259003dc90 0x7f2590040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:46.349 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.346+0000 7f25ba7fc640 1 --2- 10.20.193.52:0/3776371899 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f259003dc90 0x7f2590040150 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25a40099c0 tx=0x7f25a4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:46.351 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.349+0000 7f25c08e4640 1 -- 10.20.193.52:0/3776371899 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f25b0047270 con 0x7f25bc10d6f0 2026-02-24T18:18:46.434 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.431+0000 7f25c18e6640 1 -- 10.20.193.52:0/3776371899 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25bc10db50 con 0x7f25bc10d6f0 2026-02-24T18:18:46.434 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.431+0000 7f25c08e4640 1 -- 10.20.193.52:0/3776371899 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+7362 (secure 0 0 0) 0x7f25b004a3c0 con 0x7f25bc10d6f0 2026-02-24T18:18:46.434 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:46.434 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":20,"fsid":"08cedbc6-11ad-11f1-a33f-d404e6e7d460","created":"2026-02-24T18:17:34.352867+0000","modified":"2026-02-24T18:18:46.085135+0000","last_up_change":"2026-02-24T18:18:43.499514+0000","last_in_change":"2026-02-24T18:18:27.156353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T18:18:45.174362+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9f4f18e-df8e-4e3b-8e5f-88c26770f5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6802","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6803","nonce":3519871937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6804","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6805","nonce":3519871937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6808","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6809","nonce":3519871937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6806","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6807","nonce":3519871937}]},"public_addr":"10.20.193.52:6803/3519871937","cluster_addr":"10.20.193.52:6805/3519871937","heartbeat_back_addr":"10.20.193.52:6809/3519871937","heartbeat_front_addr":"10.20.193.52:6807/3519871937","state":["exists","up"]},{"osd":1,"uuid":"4333ab0f-7dc0-4585-8888-50d9eee9be76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6810","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6811","nonce":1866424205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6812","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6813","nonce":1866424205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6816","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6817","nonce":1866424205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6814","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6815","nonce":1866424205}]},"public_addr":"10.20.193.52:6811/1866424205","cluster_addr":"10.20.193.52:6813/1866424205","heartbeat_back_addr":"10.20.193.52:6817/1866424205","heartbeat_front_addr":"10.20.193.52:6815/1866424205","state":["exists","up"]},{"osd":2,"uuid":"2595bd04-35f8-4296-b0be-313e8f0305c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6818","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6819","nonce":97806604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6820","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6821","nonce":97806604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6824","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6825","nonce":97806604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6822","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6823","nonce":97806604}]},"public_addr":"10.20.193.52:6819/97806604","cluster_addr":"10.20.193.52:6821/97806604","heartbeat_back_addr":"10.20.193.52:6825/97806604","heartbeat_front_addr":"10.20.193.52:6823/97806604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T18:18:20.185746+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T18:18:31.205174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T18:18:42.121811+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.52:0/105634038":"2026-02-25T18:17:53.140268+0000","10.20.193.52:6801/3088300703":"2026-02-25T18:17:53.140268+0000","10.20.193.52:6800/3088300703":"2026-02-25T18:17:53.140268+0000","10.20.193.52:0/3643231119":"2026-02-25T18:17:53.140268+0000","10.20.193.52:0/1206891036":"2026-02-25T18:17:53.140268+0000","10.20.193.52:0/885680259":"2026-02-25T18:17:44.181278+0000","10.20.193.52:0/2040469486":"2026-02-25T18:17:44.181278+0000","10.20.193.52:6801/4278953045":"2026-02-25T18:17:44.181278+0000","10.20.193.52:6800/4278953045":"2026-02-25T18:17:44.181278+0000","10.20.193.52:0/1211468346":"2026-02-25T18:17:44.181278+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 10 mgrc shutdown 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 1 -- 10.20.193.52:0/3776371899 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f259003dc90 msgr2=0x7f2590040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 1 --2- 10.20.193.52:0/3776371899 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f259003dc90 0x7f2590040150 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25a40099c0 tx=0x7f25a4006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 1 -- 10.20.193.52:0/3776371899 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f25bc10d6f0 msgr2=0x7f25bc1a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 1 --2- 10.20.193.52:0/3776371899 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f25bc10d6f0 0x7f25bc1a4060 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f25b0004290 tx=0x7f25b00042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 1 -- 10.20.193.52:0/3776371899 shutdown_connections 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 1 --2- 10.20.193.52:0/3776371899 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f259003dc90 0x7f2590040150 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 1 --2- 10.20.193.52:0/3776371899 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f25bc10d6f0 0x7f25bc1a4060 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 1 -- 10.20.193.52:0/3776371899 >> 10.20.193.52:0/3776371899 conn(0x7f25bc06cd20 msgr2=0x7f25bc10cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 1 -- 10.20.193.52:0/3776371899 shutdown_connections 2026-02-24T18:18:46.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.432+0000 7f25c18e6640 1 -- 10.20.193.52:0/3776371899 wait complete. 2026-02-24T18:18:46.469 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-24T18:18:46.469 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T18:18:46.616 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:46.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:46 trial052 ceph-mon[39446]: pgmap v35: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T18:18:46.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:46 trial052 ceph-mon[39446]: from='client.? 10.20.193.80:0/2042311672' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-24T18:18:46.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:46 trial052 ceph-mon[39446]: from='client.? 10.20.193.80:0/2042311672' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T18:18:46.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:46 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/3484151880' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-24T18:18:46.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:46 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-24T18:18:46.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:46 trial052 ceph-mon[39446]: osdmap e20: 3 total, 3 up, 3 in 2026-02-24T18:18:46.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:46 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-24T18:18:46.715 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:46 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/3776371899' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-24T18:18:46.718 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.716+0000 7f55e5264640 1 -- 10.20.193.52:0/720622576 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f55e010a650 msgr2=0x7f55e010aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:46.718 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.716+0000 7f55e5264640 1 --2- 10.20.193.52:0/720622576 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f55e010a650 0x7f55e010aa30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55d40099b0 tx=0x7f55d402f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.718 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.716+0000 7f55e5264640 1 -- 10.20.193.52:0/720622576 shutdown_connections 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.716+0000 7f55e5264640 1 --2- 10.20.193.52:0/720622576 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f55e010a650 0x7f55e010aa30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.716+0000 7f55e5264640 1 -- 10.20.193.52:0/720622576 >> 10.20.193.52:0/720622576 conn(0x7f55e0100330 msgr2=0x7f55e0102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.716+0000 7f55e5264640 1 -- 10.20.193.52:0/720622576 shutdown_connections 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.716+0000 7f55e5264640 1 -- 10.20.193.52:0/720622576 wait complete. 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.716+0000 7f55e5264640 1 Processor -- start 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.716+0000 7f55e5264640 1 -- start start 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55e5264640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f55e010a650 0x7f55e019b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55e5264640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f55e010e060 con 0x7f55e010a650 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55ded76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f55e010a650 0x7f55e019b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55ded76640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f55e010a650 0x7f55e019b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46600/0 (socket says 10.20.193.52:46600) 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55ded76640 1 -- 10.20.193.52:0/2069936945 learned_addr learned my addr 10.20.193.52:0/2069936945 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55ded76640 1 -- 10.20.193.52:0/2069936945 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e019bb70 con 0x7f55e010a650 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55ded76640 1 --2- 10.20.193.52:0/2069936945 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f55e010a650 0x7f55e019b630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55d4002410 tx=0x7f55d4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:46.719 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55bffff640 1 -- 10.20.193.52:0/2069936945 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d4038510 con 0x7f55e010a650 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55bffff640 1 -- 10.20.193.52:0/2069936945 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f55d4046070 con 0x7f55e010a650 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55e5264640 1 -- 10.20.193.52:0/2069936945 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e019be00 con 0x7f55e010a650 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55bffff640 1 -- 10.20.193.52:0/2069936945 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d4041630 con 0x7f55e010a650 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55e5264640 1 -- 10.20.193.52:0/2069936945 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e019ff00 con 0x7f55e010a650 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.717+0000 7f55e5264640 1 -- 10.20.193.52:0/2069936945 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e0105d90 con 0x7f55e010a650 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.718+0000 7f55bffff640 1 -- 10.20.193.52:0/2069936945 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f55d40386b0 con 0x7f55e010a650 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.718+0000 7f55bffff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.718+0000 7f55bffff640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.718+0000 7f55bffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.718+0000 7f55bffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.718+0000 7f55bffff640 1 --2- 10.20.193.52:0/2069936945 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f55b003dce0 0x7f55b00401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.718+0000 7f55bffff640 1 -- 10.20.193.52:0/2069936945 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3004+0+0 (secure 0 0 0) 0x7f55d4077890 con 0x7f55e010a650 2026-02-24T18:18:46.720 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.718+0000 7f55de575640 1 --2- 10.20.193.52:0/2069936945 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f55b003dce0 0x7f55b00401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:46.721 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.718+0000 7f55de575640 1 --2- 10.20.193.52:0/2069936945 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f55b003dce0 0x7f55b00401a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55c80099c0 tx=0x7f55c8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:46.723 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.721+0000 7f55bffff640 1 -- 10.20.193.52:0/2069936945 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f55d4007c50 con 0x7f55e010a650 2026-02-24T18:18:46.807 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.804+0000 7f55e5264640 1 -- 10.20.193.52:0/2069936945 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55e010aab0 con 0x7f55e010a650 2026-02-24T18:18:46.807 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.804+0000 7f55bffff640 1 -- 10.20.193.52:0/2069936945 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+7362 (secure 0 0 0) 0x7f55d40389d0 con 0x7f55e010a650 2026-02-24T18:18:46.808 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:46.808 INFO:teuthology.orchestra.run.trial052.stdout:{"epoch":20,"fsid":"08cedbc6-11ad-11f1-a33f-d404e6e7d460","created":"2026-02-24T18:17:34.352867+0000","modified":"2026-02-24T18:18:46.085135+0000","last_up_change":"2026-02-24T18:18:43.499514+0000","last_in_change":"2026-02-24T18:18:27.156353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T18:18:45.174362+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9f4f18e-df8e-4e3b-8e5f-88c26770f5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6802","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6803","nonce":3519871937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6804","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6805","nonce":3519871937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6808","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6809","nonce":3519871937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6806","nonce":3519871937},{"type":"v1","addr":"10.20.193.52:6807","nonce":3519871937}]},"public_addr":"10.20.193.52:6803/3519871937","cluster_addr":"10.20.193.52:6805/3519871937","heartbeat_back_addr":"10.20.193.52:6809/3519871937","heartbeat_front_addr":"10.20.193.52:6807/3519871937","state":["exists","up"]},{"osd":1,"uuid":"4333ab0f-7dc0-4585-8888-50d9eee9be76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6810","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6811","nonce":1866424205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6812","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6813","nonce":1866424205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6816","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6817","nonce":1866424205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6814","nonce":1866424205},{"type":"v1","addr":"10.20.193.52:6815","nonce":1866424205}]},"public_addr":"10.20.193.52:6811/1866424205","cluster_addr":"10.20.193.52:6813/1866424205","heartbeat_back_addr":"10.20.193.52:6817/1866424205","heartbeat_front_addr":"10.20.193.52:6815/1866424205","state":["exists","up"]},{"osd":2,"uuid":"2595bd04-35f8-4296-b0be-313e8f0305c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6818","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6819","nonce":97806604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6820","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6821","nonce":97806604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6824","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6825","nonce":97806604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.52:6822","nonce":97806604},{"type":"v1","addr":"10.20.193.52:6823","nonce":97806604}]},"public_addr":"10.20.193.52:6819/97806604","cluster_addr":"10.20.193.52:6821/97806604","heartbeat_back_addr":"10.20.193.52:6825/97806604","heartbeat_front_addr":"10.20.193.52:6823/97806604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T18:18:20.185746+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T18:18:31.205174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T18:18:42.121811+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.52:0/105634038":"2026-02-25T18:17:53.140268+0000","10.20.193.52:6801/3088300703":"2026-02-25T18:17:53.140268+0000","10.20.193.52:6800/3088300703":"2026-02-25T18:17:53.140268+0000","10.20.193.52:0/3643231119":"2026-02-25T18:17:53.140268+0000","10.20.193.52:0/1206891036":"2026-02-25T18:17:53.140268+0000","10.20.193.52:0/885680259":"2026-02-25T18:17:44.181278+0000","10.20.193.52:0/2040469486":"2026-02-25T18:17:44.181278+0000","10.20.193.52:6801/4278953045":"2026-02-25T18:17:44.181278+0000","10.20.193.52:6800/4278953045":"2026-02-25T18:17:44.181278+0000","10.20.193.52:0/1211468346":"2026-02-25T18:17:44.181278+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T18:18:46.809 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 10 mgrc shutdown 2026-02-24T18:18:46.809 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 1 -- 10.20.193.52:0/2069936945 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f55b003dce0 msgr2=0x7f55b00401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:46.810 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 1 --2- 10.20.193.52:0/2069936945 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f55b003dce0 0x7f55b00401a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55c80099c0 tx=0x7f55c8006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.810 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 1 -- 10.20.193.52:0/2069936945 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f55e010a650 msgr2=0x7f55e019b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:46.810 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 1 --2- 10.20.193.52:0/2069936945 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f55e010a650 0x7f55e019b630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55d4002410 tx=0x7f55d4004290 comp rx=0 tx=0).stop 2026-02-24T18:18:46.810 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 1 -- 10.20.193.52:0/2069936945 shutdown_connections 2026-02-24T18:18:46.810 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 1 --2- 10.20.193.52:0/2069936945 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f55b003dce0 0x7f55b00401a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.810 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 1 --2- 10.20.193.52:0/2069936945 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f55e010a650 0x7f55e019b630 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:46.810 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 1 -- 10.20.193.52:0/2069936945 >> 10.20.193.52:0/2069936945 conn(0x7f55e0100330 msgr2=0x7f55e0108830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:46.810 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 1 -- 10.20.193.52:0/2069936945 shutdown_connections 2026-02-24T18:18:46.810 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:46.805+0000 7f55e5264640 1 -- 10.20.193.52:0/2069936945 wait complete. 2026-02-24T18:18:46.844 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-24T18:18:46.844 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-24T18:18:46.845 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-24T18:18:47.004 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:47.005 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:47.011 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:47.117 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f5e95719640 1 -- 10.20.193.52:0/2314131250 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5e9010a640 msgr2=0x7f5e9010aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.118 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f5e95719640 1 --2- 10.20.193.52:0/2314131250 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5e9010a640 0x7f5e9010aa20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e840099b0 tx=0x7f5e8402f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.118 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f5e95719640 1 -- 10.20.193.52:0/2314131250 shutdown_connections 2026-02-24T18:18:47.118 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f5e95719640 1 --2- 10.20.193.52:0/2314131250 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5e9010a640 0x7f5e9010aa20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.118 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f5e95719640 1 -- 10.20.193.52:0/2314131250 >> 10.20.193.52:0/2314131250 conn(0x7f5e901006d0 msgr2=0x7f5e90102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.118 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f5e95719640 1 -- 10.20.193.52:0/2314131250 shutdown_connections 2026-02-24T18:18:47.118 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f5e95719640 1 -- 10.20.193.52:0/2314131250 wait complete. 2026-02-24T18:18:47.119 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7fa730dd9640 1 -- 10.20.193.52:0/117405574 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa72c10a650 msgr2=0x7fa72c10aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.119 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7fa730dd9640 1 --2- 10.20.193.52:0/117405574 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa72c10a650 0x7fa72c10aa30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa7200099b0 tx=0x7fa72002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.119 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7fa730dd9640 1 -- 10.20.193.52:0/117405574 shutdown_connections 2026-02-24T18:18:47.119 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7fa730dd9640 1 --2- 10.20.193.52:0/117405574 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa72c10a650 0x7fa72c10aa30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.119 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7fa730dd9640 1 -- 10.20.193.52:0/117405574 >> 10.20.193.52:0/117405574 conn(0x7fa72c100330 msgr2=0x7fa72c102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.119 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7fa730dd9640 1 -- 10.20.193.52:0/117405574 shutdown_connections 2026-02-24T18:18:47.119 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7fa730dd9640 1 -- 10.20.193.52:0/117405574 wait complete. 2026-02-24T18:18:47.119 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7fa730dd9640 1 Processor -- start 2026-02-24T18:18:47.119 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa730dd9640 1 -- start start 2026-02-24T18:18:47.120 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e95719640 1 Processor -- start 2026-02-24T18:18:47.120 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e95719640 1 -- start start 2026-02-24T18:18:47.120 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa730dd9640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa72c10a650 0x7fa72c19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.120 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa730dd9640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c10e060 con 0x7fa72c10a650 2026-02-24T18:18:47.121 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f94a20cd640 1 -- 10.20.193.52:0/3407130813 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f949c102600 msgr2=0x7f949c1029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.121 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f94a20cd640 1 --2- 10.20.193.52:0/3407130813 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f949c102600 0x7f949c1029e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f94880099b0 tx=0x7f948802f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.121 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa72a575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa72c10a650 0x7fa72c19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.122 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f94a20cd640 1 -- 10.20.193.52:0/3407130813 shutdown_connections 2026-02-24T18:18:47.122 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f94a20cd640 1 --2- 10.20.193.52:0/3407130813 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f949c102600 0x7f949c1029e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.122 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f94a20cd640 1 -- 10.20.193.52:0/3407130813 >> 10.20.193.52:0/3407130813 conn(0x7f949c079240 msgr2=0x7f949c100510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.122 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f94a20cd640 1 -- 10.20.193.52:0/3407130813 shutdown_connections 2026-02-24T18:18:47.122 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.114+0000 7f94a20cd640 1 -- 10.20.193.52:0/3407130813 wait complete. 2026-02-24T18:18:47.122 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa72a575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa72c10a650 0x7fa72c19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46632/0 (socket says 10.20.193.52:46632) 2026-02-24T18:18:47.123 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa72a575640 1 -- 10.20.193.52:0/29441142 learned_addr learned my addr 10.20.193.52:0/29441142 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:47.123 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e95719640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5e9010a640 0x7f5e9019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.123 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e95719640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9010e050 con 0x7f5e9010a640 2026-02-24T18:18:47.123 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e8effd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5e9010a640 0x7f5e9019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.123 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e8effd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5e9010a640 0x7f5e9019b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46640/0 (socket says 10.20.193.52:46640) 2026-02-24T18:18:47.124 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e8effd640 1 -- 10.20.193.52:0/18700865 learned_addr learned my addr 10.20.193.52:0/18700865 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:47.124 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f94a20cd640 1 Processor -- start 2026-02-24T18:18:47.124 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa72a575640 1 -- 10.20.193.52:0/29441142 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c19bbc0 con 0x7fa72c10a650 2026-02-24T18:18:47.124 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f94a20cd640 1 -- start start 2026-02-24T18:18:47.125 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa72a575640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa72c10a650 0x7fa72c19b680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa720002410 tx=0x7fa720004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.125 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e8effd640 1 -- 10.20.193.52:0/18700865 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9019bbd0 con 0x7f5e9010a640 2026-02-24T18:18:47.125 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa7137fe640 1 -- 10.20.193.52:0/29441142 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa720038510 con 0x7fa72c10a650 2026-02-24T18:18:47.126 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e8effd640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5e9010a640 0x7f5e9019b690 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5e84004290 tx=0x7f5e840042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.126 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f94a20cd640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f949c102600 0x7f949c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.126 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f94a20cd640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f949c10bdb0 con 0x7f949c102600 2026-02-24T18:18:47.127 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa72c19be50 con 0x7fa72c10a650 2026-02-24T18:18:47.127 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa72c19ff50 con 0x7fa72c10a650 2026-02-24T18:18:47.127 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa7137fe640 1 -- 10.20.193.52:0/29441142 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa720046070 con 0x7fa72c10a650 2026-02-24T18:18:47.127 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f949b7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f949c102600 0x7f949c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.127 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f949b7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f949c102600 0x7f949c1993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46652/0 (socket says 10.20.193.52:46652) 2026-02-24T18:18:47.127 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f949b7fe640 1 -- 10.20.193.52:0/919666854 learned_addr learned my addr 10.20.193.52:0/919666854 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:47.128 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7fa7137fe640 1 -- 10.20.193.52:0/29441142 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa72004b5f0 con 0x7fa72c10a650 2026-02-24T18:18:47.128 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e6ffff640 1 -- 10.20.193.52:0/18700865 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e84038510 con 0x7f5e9010a640 2026-02-24T18:18:47.129 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9019be60 con 0x7f5e9010a640 2026-02-24T18:18:47.129 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e6ffff640 1 -- 10.20.193.52:0/18700865 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f5e84046070 con 0x7f5e9010a640 2026-02-24T18:18:47.129 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e6ffff640 1 -- 10.20.193.52:0/18700865 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e84041610 con 0x7f5e9010a640 2026-02-24T18:18:47.129 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9019ff60 con 0x7f5e9010a640 2026-02-24T18:18:47.129 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.115+0000 7f949b7fe640 1 -- 10.20.193.52:0/919666854 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c199910 con 0x7f949c102600 2026-02-24T18:18:47.129 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f949b7fe640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f949c102600 0x7f949c1993d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9488002410 tx=0x7f9488004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.130 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e9019c320 con 0x7f5e9010a640 2026-02-24T18:18:47.130 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f9498ff9640 1 -- 10.20.193.52:0/919666854 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9488038510 con 0x7f949c102600 2026-02-24T18:18:47.130 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f9498ff9640 1 -- 10.20.193.52:0/919666854 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f9488046070 con 0x7f949c102600 2026-02-24T18:18:47.130 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949c199ba0 con 0x7f949c102600 2026-02-24T18:18:47.131 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f9498ff9640 1 -- 10.20.193.52:0/919666854 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9488041630 con 0x7f949c102600 2026-02-24T18:18:47.131 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa72c19c310 con 0x7fa72c10a650 2026-02-24T18:18:47.131 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f949c19dca0 con 0x7f949c102600 2026-02-24T18:18:47.132 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa7137fe640 1 -- 10.20.193.52:0/29441142 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fa7200386b0 con 0x7fa72c10a650 2026-02-24T18:18:47.132 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa7137fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:47.132 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa7137fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:47.132 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa7137fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.132 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa7137fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.133 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa7137fe640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa70403dce0 0x7fa7040401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.133 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa7137fe640 1 -- 10.20.193.52:0/29441142 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7fa720077820 con 0x7fa72c10a650 2026-02-24T18:18:47.133 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f949c19a060 con 0x7f949c102600 2026-02-24T18:18:47.133 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f5e6ffff640 1 -- 10.20.193.52:0/18700865 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f5e840386b0 con 0x7f5e9010a640 2026-02-24T18:18:47.133 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f5e6ffff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:47.134 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa7137fe640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604] conn(0x7fa704042b20 0x7fa704044f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.134 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa7137fe640 1 -- 10.20.193.52:0/29441142 --> [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa720033e80 con 0x7fa704042b20 2026-02-24T18:18:47.134 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa7137fe640 1 -- 10.20.193.52:0/29441142 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa72007e050 con 0x7fa72c10a650 2026-02-24T18:18:47.134 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa729d74640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa70403dce0 0x7fa7040401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.134 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7fa72ad76640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604] conn(0x7fa704042b20 0x7fa704044f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.135 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f5e6ffff640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:47.135 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f5e6ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.135 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f5e6ffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.135 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.116+0000 7f5e6ffff640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5e6403dc90 0x7f5e64040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.135 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f5e6ffff640 1 -- 10.20.193.52:0/18700865 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f5e84078480 con 0x7f5e9010a640 2026-02-24T18:18:47.136 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f9498ff9640 1 -- 10.20.193.52:0/919666854 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f94880386b0 con 0x7f949c102600 2026-02-24T18:18:47.136 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f9498ff9640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:47.136 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7fa729d74640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa70403dce0 0x7fa7040401a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7140099c0 tx=0x7fa714006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.137 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f5e6ffff640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937] conn(0x7f5e64042ad0 0x7f5e64044f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.137 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f5e6ffff640 1 -- 10.20.193.52:0/18700865 --> [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e8403fec0 con 0x7f5e64042ad0 2026-02-24T18:18:47.137 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f5e6ffff640 1 -- 10.20.193.52:0/18700865 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5e840788f0 con 0x7f5e9010a640 2026-02-24T18:18:47.137 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f5e8e7fc640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5e6403dc90 0x7f5e64040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.137 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f5e8f7fe640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937] conn(0x7f5e64042ad0 0x7f5e64044f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.137 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f9498ff9640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:47.137 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f9498ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.138 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f9498ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.138 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f9498ff9640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f947003dce0 0x7f94700401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.138 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7fa72ad76640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604] conn(0x7fa704042b20 0x7fa704044f60 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.138 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f949affd640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f947003dce0 0x7f94700401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.139 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f5e8e7fc640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5e6403dc90 0x7f5e64040150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e780099c0 tx=0x7f5e78006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.139 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f9498ff9640 1 -- 10.20.193.52:0/919666854 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f9488077f30 con 0x7f949c102600 2026-02-24T18:18:47.139 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f9498ff9640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205] conn(0x7f9470042b20 0x7f9470044f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.139 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f9498ff9640 1 -- 10.20.193.52:0/919666854 --> [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9470045630 con 0x7f9470042b20 2026-02-24T18:18:47.139 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f9498ff9640 1 -- 10.20.193.52:0/919666854 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9488078320 con 0x7f949c102600 2026-02-24T18:18:47.140 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f949affd640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f947003dce0 0x7f94700401a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f948c0099c0 tx=0x7f948c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.140 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f5e8f7fe640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937] conn(0x7f5e64042ad0 0x7f5e64044f10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.140 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f949bfff640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205] conn(0x7f9470042b20 0x7f9470044f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.140 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7f949bfff640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205] conn(0x7f9470042b20 0x7f9470044f60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.141 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.117+0000 7fa7137fe640 1 -- 10.20.193.52:0/29441142 <== osd.2 v2:10.20.193.52:6818/97806604 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fa720033e80 con 0x7fa704042b20 2026-02-24T18:18:47.141 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.118+0000 7f5e6ffff640 1 -- 10.20.193.52:0/18700865 <== osd.0 v2:10.20.193.52:6802/3519871937 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f5e8403fec0 con 0x7f5e64042ad0 2026-02-24T18:18:47.141 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.120+0000 7f9498ff9640 1 -- 10.20.193.52:0/919666854 <== osd.1 v2:10.20.193.52:6810/1866424205 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f9470045630 con 0x7f9470042b20 2026-02-24T18:18:47.142 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 --> [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa72c1a06c0 con 0x7fa704042b20 2026-02-24T18:18:47.142 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa7137fe640 1 -- 10.20.193.52:0/29441142 <== osd.2 v2:10.20.193.52:6818/97806604 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa72c1a06c0 con 0x7fa704042b20 2026-02-24T18:18:47.142 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604] conn(0x7fa704042b20 msgr2=0x7fa704044f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.142 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604] conn(0x7fa704042b20 0x7fa704044f60 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.143 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 --> [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e901a07d0 con 0x7f5e64042ad0 2026-02-24T18:18:47.144 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 10 mgrc shutdown 2026-02-24T18:18:47.144 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa70403dce0 msgr2=0x7fa7040401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.144 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa70403dce0 0x7fa7040401a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7140099c0 tx=0x7fa714006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.144 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa72c10a650 msgr2=0x7fa72c19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.144 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa72c10a650 0x7fa72c19b680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa720002410 tx=0x7fa720004290 comp rx=0 tx=0).stop 2026-02-24T18:18:47.144 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 shutdown_connections 2026-02-24T18:18:47.144 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6818/97806604,v1:10.20.193.52:6819/97806604] conn(0x7fa704042b20 0x7fa704044f60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.144 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa70403dce0 0x7fa7040401a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.144 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 --2- 10.20.193.52:0/29441142 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa72c10a650 0x7fa72c19b680 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.144 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 >> 10.20.193.52:0/29441142 conn(0x7fa72c100330 msgr2=0x7fa72c1087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.145 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 shutdown_connections 2026-02-24T18:18:47.145 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e6ffff640 1 -- 10.20.193.52:0/18700865 <== osd.0 v2:10.20.193.52:6802/3519871937 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5e901a07d0 con 0x7f5e64042ad0 2026-02-24T18:18:47.145 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7fa730dd9640 1 -- 10.20.193.52:0/29441142 wait complete. 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937] conn(0x7f5e64042ad0 msgr2=0x7f5e64044f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937] conn(0x7f5e64042ad0 0x7f5e64044f10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 10 mgrc shutdown 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5e6403dc90 msgr2=0x7f5e64040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5e6403dc90 0x7f5e64040150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e780099c0 tx=0x7f5e78006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5e9010a640 msgr2=0x7f5e9019b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5e9010a640 0x7f5e9019b690 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5e84004290 tx=0x7f5e840042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 shutdown_connections 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6802/3519871937,v1:10.20.193.52:6803/3519871937] conn(0x7f5e64042ad0 0x7f5e64044f10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5e6403dc90 0x7f5e64040150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.147 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 --2- 10.20.193.52:0/18700865 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5e9010a640 0x7f5e9019b690 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.148 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.124+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 >> 10.20.193.52:0/18700865 conn(0x7f5e901006d0 msgr2=0x7f5e90106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.148 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.125+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 shutdown_connections 2026-02-24T18:18:47.148 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.125+0000 7f5e95719640 1 -- 10.20.193.52:0/18700865 wait complete. 2026-02-24T18:18:47.148 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.126+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 --> [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f949c19e450 con 0x7f9470042b20 2026-02-24T18:18:47.148 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.126+0000 7f9498ff9640 1 -- 10.20.193.52:0/919666854 <== osd.1 v2:10.20.193.52:6810/1866424205 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f949c19e450 con 0x7f9470042b20 2026-02-24T18:18:47.150 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205] conn(0x7f9470042b20 msgr2=0x7f9470044f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.150 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205] conn(0x7f9470042b20 0x7f9470044f60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.150 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 10 mgrc shutdown 2026-02-24T18:18:47.150 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f947003dce0 msgr2=0x7f94700401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.150 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f947003dce0 0x7f94700401a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f948c0099c0 tx=0x7f948c006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.151 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f949c102600 msgr2=0x7f949c1993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.151 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f949c102600 0x7f949c1993d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9488002410 tx=0x7f9488004290 comp rx=0 tx=0).stop 2026-02-24T18:18:47.151 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 shutdown_connections 2026-02-24T18:18:47.151 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6810/1866424205,v1:10.20.193.52:6811/1866424205] conn(0x7f9470042b20 0x7f9470044f60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.151 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f947003dce0 0x7f94700401a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.151 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 --2- 10.20.193.52:0/919666854 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f949c102600 0x7f949c1993d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.151 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 >> 10.20.193.52:0/919666854 conn(0x7f949c079240 msgr2=0x7f949c106740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.151 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 shutdown_connections 2026-02-24T18:18:47.151 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.127+0000 7f94a20cd640 1 -- 10.20.193.52:0/919666854 wait complete. 2026-02-24T18:18:47.167 INFO:teuthology.orchestra.run.trial052.stdout:77309411332 2026-02-24T18:18:47.167 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T18:18:47.168 INFO:teuthology.orchestra.run.trial052.stdout:60129542150 2026-02-24T18:18:47.169 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T18:18:47.172 INFO:teuthology.orchestra.run.trial052.stdout:38654705670 2026-02-24T18:18:47.172 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T18:18:47.284 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69056]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T18:18:47.284 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69056]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T18:18:47.284 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T18:18:47.284 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69056]: pam_unix(sudo:session): session closed for user root 2026-02-24T18:18:47.322 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:47.386 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:47.387 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:47.434 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/3125022659 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0e58102600 msgr2=0x7f0e581029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.434 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 --2- 10.20.193.52:0/3125022659 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0e58102600 0x7f0e581029e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0e440099b0 tx=0x7f0e4402f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.434 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/3125022659 shutdown_connections 2026-02-24T18:18:47.434 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 --2- 10.20.193.52:0/3125022659 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0e58102600 0x7f0e581029e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.434 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/3125022659 >> 10.20.193.52:0/3125022659 conn(0x7f0e58079240 msgr2=0x7f0e58100510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.434 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/3125022659 shutdown_connections 2026-02-24T18:18:47.434 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/3125022659 wait complete. 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 Processor -- start 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 -- start start 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0e58102600 0x7f0e58075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e5dbc5640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5810bdb0 con 0x7f0e58102600 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e577fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0e58102600 0x7f0e58075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e577fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0e58102600 0x7f0e58075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46702/0 (socket says 10.20.193.52:46702) 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.430+0000 7f0e577fe640 1 -- 10.20.193.52:0/1308384078 learned_addr learned my addr 10.20.193.52:0/1308384078 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.431+0000 7f0e577fe640 1 -- 10.20.193.52:0/1308384078 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e58077260 con 0x7f0e58102600 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.431+0000 7f0e577fe640 1 --2- 10.20.193.52:0/1308384078 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0e58102600 0x7f0e58075370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e44002410 tx=0x7f0e44004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.431+0000 7f0e54ff9640 1 -- 10.20.193.52:0/1308384078 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e44038510 con 0x7f0e58102600 2026-02-24T18:18:47.435 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.431+0000 7f0e54ff9640 1 -- 10.20.193.52:0/1308384078 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0e44046070 con 0x7f0e58102600 2026-02-24T18:18:47.436 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.431+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/1308384078 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e580758b0 con 0x7f0e58102600 2026-02-24T18:18:47.436 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.431+0000 7f0e54ff9640 1 -- 10.20.193.52:0/1308384078 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e44041630 con 0x7f0e58102600 2026-02-24T18:18:47.436 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.431+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/1308384078 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e58075d70 con 0x7f0e58102600 2026-02-24T18:18:47.436 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.431+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/1308384078 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e58103ae0 con 0x7f0e58102600 2026-02-24T18:18:47.437 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.432+0000 7f0e54ff9640 1 -- 10.20.193.52:0/1308384078 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f0e440386b0 con 0x7f0e58102600 2026-02-24T18:18:47.437 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.432+0000 7f0e54ff9640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:47.437 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.432+0000 7f0e54ff9640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:47.437 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.432+0000 7f0e54ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.437 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.432+0000 7f0e54ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.437 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.432+0000 7f0e54ff9640 1 --2- 10.20.193.52:0/1308384078 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0e2c03dc90 0x7f0e2c040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.437 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.432+0000 7f0e54ff9640 1 -- 10.20.193.52:0/1308384078 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f0e44078040 con 0x7f0e58102600 2026-02-24T18:18:47.437 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.432+0000 7f0e56ffd640 1 --2- 10.20.193.52:0/1308384078 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0e2c03dc90 0x7f0e2c040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.438 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.432+0000 7f0e56ffd640 1 --2- 10.20.193.52:0/1308384078 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0e2c03dc90 0x7f0e2c040150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e480099c0 tx=0x7f0e48006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.438 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.434+0000 7f0e54ff9640 1 -- 10.20.193.52:0/1308384078 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0e44041990 con 0x7f0e58102600 2026-02-24T18:18:47.497 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f0b98226640 1 -- 10.20.193.52:0/680800430 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0b90077620 msgr2=0x7f0b90077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.497 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f0b98226640 1 --2- 10.20.193.52:0/680800430 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0b90077620 0x7f0b90077a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b800099b0 tx=0x7f0b8002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.497 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f0b98226640 1 -- 10.20.193.52:0/680800430 shutdown_connections 2026-02-24T18:18:47.498 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f0b98226640 1 --2- 10.20.193.52:0/680800430 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0b90077620 0x7f0b90077a00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.498 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f0b98226640 1 -- 10.20.193.52:0/680800430 >> 10.20.193.52:0/680800430 conn(0x7f0b901006d0 msgr2=0x7f0b90102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.498 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f0b98226640 1 -- 10.20.193.52:0/680800430 shutdown_connections 2026-02-24T18:18:47.498 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f0b98226640 1 -- 10.20.193.52:0/680800430 wait complete. 2026-02-24T18:18:47.499 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f5f2eec2640 1 -- 10.20.193.52:0/4251161759 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5f2810a4d0 msgr2=0x7f5f2810a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.499 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f5f2eec2640 1 --2- 10.20.193.52:0/4251161759 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5f2810a4d0 0x7f5f2810a8b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5f180099b0 tx=0x7f5f1802f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.499 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f5f2eec2640 1 -- 10.20.193.52:0/4251161759 shutdown_connections 2026-02-24T18:18:47.499 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f5f2eec2640 1 --2- 10.20.193.52:0/4251161759 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5f2810a4d0 0x7f5f2810a8b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.499 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f5f2eec2640 1 -- 10.20.193.52:0/4251161759 >> 10.20.193.52:0/4251161759 conn(0x7f5f28100140 msgr2=0x7f5f28102560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.499 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f5f2eec2640 1 -- 10.20.193.52:0/4251161759 shutdown_connections 2026-02-24T18:18:47.499 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f5f2eec2640 1 -- 10.20.193.52:0/4251161759 wait complete. 2026-02-24T18:18:47.500 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f0b98226640 1 Processor -- start 2026-02-24T18:18:47.500 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f0b98226640 1 -- start start 2026-02-24T18:18:47.500 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f5f2eec2640 1 Processor -- start 2026-02-24T18:18:47.500 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.494+0000 7f5f2eec2640 1 -- start start 2026-02-24T18:18:47.501 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b98226640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0b90077620 0x7f0b901a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.501 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b98226640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0b901125b0 con 0x7f0b90077620 2026-02-24T18:18:47.501 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b95f9b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0b90077620 0x7f0b901a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.501 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b95f9b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0b90077620 0x7f0b901a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46726/0 (socket says 10.20.193.52:46726) 2026-02-24T18:18:47.501 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b95f9b640 1 -- 10.20.193.52:0/1609445637 learned_addr learned my addr 10.20.193.52:0/1609445637 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:47.502 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f2eec2640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5f2810a4d0 0x7f5f2819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.502 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f2eec2640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2810de50 con 0x7f5f2810a4d0 2026-02-24T18:18:47.502 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f2dec0640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5f2810a4d0 0x7f5f2819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.502 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f2dec0640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5f2810a4d0 0x7f5f2819b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46732/0 (socket says 10.20.193.52:46732) 2026-02-24T18:18:47.502 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f2dec0640 1 -- 10.20.193.52:0/597686280 learned_addr learned my addr 10.20.193.52:0/597686280 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:47.502 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b95f9b640 1 -- 10.20.193.52:0/1609445637 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b901a5e00 con 0x7f0b90077620 2026-02-24T18:18:47.503 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f2dec0640 1 -- 10.20.193.52:0/597686280 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2819b9a0 con 0x7f5f2810a4d0 2026-02-24T18:18:47.503 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b95f9b640 1 --2- 10.20.193.52:0/1609445637 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0b90077620 0x7f0b901a58c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b80002410 tx=0x7f0b80004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.504 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f2dec0640 1 --2- 10.20.193.52:0/597686280 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5f2810a4d0 0x7f5f2819b460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5f18004290 tx=0x7f5f180042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.504 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b7effd640 1 -- 10.20.193.52:0/1609445637 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b80038510 con 0x7f0b90077620 2026-02-24T18:18:47.504 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b7effd640 1 -- 10.20.193.52:0/1609445637 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0b80046070 con 0x7f0b90077620 2026-02-24T18:18:47.504 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b98226640 1 -- 10.20.193.52:0/1609445637 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b901a6090 con 0x7f0b90077620 2026-02-24T18:18:47.504 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b7effd640 1 -- 10.20.193.52:0/1609445637 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b80041630 con 0x7f0b90077620 2026-02-24T18:18:47.505 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b98226640 1 -- 10.20.193.52:0/1609445637 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9019fa80 con 0x7f0b90077620 2026-02-24T18:18:47.505 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f16ffd640 1 -- 10.20.193.52:0/597686280 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f18038510 con 0x7f5f2810a4d0 2026-02-24T18:18:47.505 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f16ffd640 1 -- 10.20.193.52:0/597686280 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f5f18046070 con 0x7f5f2810a4d0 2026-02-24T18:18:47.505 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f2eec2640 1 -- 10.20.193.52:0/597686280 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2819bc30 con 0x7f5f2810a4d0 2026-02-24T18:18:47.506 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f16ffd640 1 -- 10.20.193.52:0/597686280 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f18041610 con 0x7f5f2810a4d0 2026-02-24T18:18:47.506 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f5f2eec2640 1 -- 10.20.193.52:0/597686280 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2819fd30 con 0x7f5f2810a4d0 2026-02-24T18:18:47.506 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.495+0000 7f0b98226640 1 -- 10.20.193.52:0/1609445637 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b90078d60 con 0x7f0b90077620 2026-02-24T18:18:47.506 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f5f2eec2640 1 -- 10.20.193.52:0/597686280 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f28105b80 con 0x7f5f2810a4d0 2026-02-24T18:18:47.507 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f0b7effd640 1 -- 10.20.193.52:0/1609445637 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f0b800386b0 con 0x7f0b90077620 2026-02-24T18:18:47.507 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f0b7effd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:47.507 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f5f16ffd640 1 -- 10.20.193.52:0/597686280 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f5f18041910 con 0x7f5f2810a4d0 2026-02-24T18:18:47.507 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f5f16ffd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:47.508 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f0b7effd640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:47.508 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f0b7effd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.508 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f0b7effd640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.508 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f0b7effd640 1 --2- 10.20.193.52:0/1609445637 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0b6c03dce0 0x7f0b6c0401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.508 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f0b7effd640 1 -- 10.20.193.52:0/1609445637 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f0b800777b0 con 0x7f0b90077620 2026-02-24T18:18:47.508 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f5f16ffd640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:47.509 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f5f16ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.509 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f5f16ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:47.509 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f5f16ffd640 1 --2- 10.20.193.52:0/597686280 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5f0403dc90 0x7f5f04040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:47.509 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f0b9579a640 1 --2- 10.20.193.52:0/1609445637 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0b6c03dce0 0x7f0b6c0401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.510 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f5f16ffd640 1 -- 10.20.193.52:0/597686280 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f5f18078040 con 0x7f5f2810a4d0 2026-02-24T18:18:47.510 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f5f2d6bf640 1 --2- 10.20.193.52:0/597686280 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5f0403dc90 0x7f5f04040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:47.510 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f0b9579a640 1 --2- 10.20.193.52:0/1609445637 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0b6c03dce0 0x7f0b6c0401a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b840099c0 tx=0x7f0b84006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.510 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.496+0000 7f5f2d6bf640 1 --2- 10.20.193.52:0/597686280 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5f0403dc90 0x7f5f04040150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0099c0 tx=0x7f5f1c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:47.511 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.498+0000 7f0b7effd640 1 -- 10.20.193.52:0/1609445637 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0b80007c50 con 0x7f0b90077620 2026-02-24T18:18:47.511 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.501+0000 7f5f16ffd640 1 -- 10.20.193.52:0/597686280 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5f18050d70 con 0x7f5f2810a4d0 2026-02-24T18:18:47.527 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.525+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/1308384078 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0e580768a0 con 0x7f0e58102600 2026-02-24T18:18:47.528 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.525+0000 7f0e54ff9640 1 -- 10.20.193.52:0/1308384078 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e44051250 con 0x7f0e58102600 2026-02-24T18:18:47.528 INFO:teuthology.orchestra.run.trial052.stdout:77309411331 2026-02-24T18:18:47.530 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 10 mgrc shutdown 2026-02-24T18:18:47.530 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/1308384078 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0e2c03dc90 msgr2=0x7f0e2c040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.530 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 1 --2- 10.20.193.52:0/1308384078 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0e2c03dc90 0x7f0e2c040150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e480099c0 tx=0x7f0e48006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.530 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/1308384078 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0e58102600 msgr2=0x7f0e58075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.530 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 1 --2- 10.20.193.52:0/1308384078 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0e58102600 0x7f0e58075370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e44002410 tx=0x7f0e44004290 comp rx=0 tx=0).stop 2026-02-24T18:18:47.530 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/1308384078 shutdown_connections 2026-02-24T18:18:47.530 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 1 --2- 10.20.193.52:0/1308384078 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0e2c03dc90 0x7f0e2c040150 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.531 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 1 --2- 10.20.193.52:0/1308384078 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0e58102600 0x7f0e58075370 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.531 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/1308384078 >> 10.20.193.52:0/1308384078 conn(0x7f0e58079240 msgr2=0x7f0e580fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.531 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/1308384078 shutdown_connections 2026-02-24T18:18:47.531 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.527+0000 7f0e5dbc5640 1 -- 10.20.193.52:0/1308384078 wait complete. 2026-02-24T18:18:47.537 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69274]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-24T18:18:47.537 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69274]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T18:18:47.537 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T18:18:47.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69274]: pam_unix(sudo:session): session closed for user root 2026-02-24T18:18:47.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69308]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-24T18:18:47.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69308]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T18:18:47.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T18:18:47.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69308]: pam_unix(sudo:session): session closed for user root 2026-02-24T18:18:47.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2069936945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-24T18:18:47.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-24T18:18:47.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 ceph-mon[39446]: osdmap e21: 3 total, 3 up, 3 in 2026-02-24T18:18:47.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:47.538 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' 2026-02-24T18:18:47.539 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 ceph-mon[39446]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T18:18:47.539 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 ceph-mon[39446]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T18:18:47.539 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:47 trial052 ceph-mon[39446]: from='mgr.14150 10.20.193.52:0/4160939684' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-24T18:18:47.539 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69067]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T18:18:47.539 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69067]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T18:18:47.539 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T18:18:47.539 INFO:journalctl@ceph.osd.0.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69067]: pam_unix(sudo:session): session closed for user root 2026-02-24T18:18:47.540 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69097]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T18:18:47.540 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69097]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T18:18:47.540 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T18:18:47.540 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69097]: pam_unix(sudo:session): session closed for user root 2026-02-24T18:18:47.540 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69151]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T18:18:47.540 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69151]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T18:18:47.540 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T18:18:47.540 INFO:journalctl@ceph.osd.1.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69151]: pam_unix(sudo:session): session closed for user root 2026-02-24T18:18:47.541 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69206]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-24T18:18:47.541 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69206]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T18:18:47.541 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T18:18:47.541 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69206]: pam_unix(sudo:session): session closed for user root 2026-02-24T18:18:47.541 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69256]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-24T18:18:47.541 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69256]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T18:18:47.541 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T18:18:47.541 INFO:journalctl@ceph.osd.2.trial052.stdout:Feb 24 18:18:47 trial052 sudo[69256]: pam_unix(sudo:session): session closed for user root 2026-02-24T18:18:47.566 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411331 for osd.2 2026-02-24T18:18:47.590 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.586+0000 7f5f2eec2640 1 -- 10.20.193.52:0/597686280 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5f2810a930 con 0x7f5f2810a4d0 2026-02-24T18:18:47.590 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.587+0000 7f5f16ffd640 1 -- 10.20.193.52:0/597686280 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f180762d0 con 0x7f5f2810a4d0 2026-02-24T18:18:47.590 INFO:teuthology.orchestra.run.trial052.stdout:38654705669 2026-02-24T18:18:47.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.588+0000 7f0b98226640 1 -- 10.20.193.52:0/1609445637 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0b90077a80 con 0x7f0b90077620 2026-02-24T18:18:47.591 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.588+0000 7f0b7effd640 1 -- 10.20.193.52:0/1609445637 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b800389d0 con 0x7f0b90077620 2026-02-24T18:18:47.591 INFO:teuthology.orchestra.run.trial052.stdout:60129542149 2026-02-24T18:18:47.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 10 mgrc shutdown 2026-02-24T18:18:47.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 1 -- 10.20.193.52:0/597686280 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5f0403dc90 msgr2=0x7f5f04040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.592 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 1 --2- 10.20.193.52:0/597686280 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5f0403dc90 0x7f5f04040150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0099c0 tx=0x7f5f1c006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 1 -- 10.20.193.52:0/597686280 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5f2810a4d0 msgr2=0x7f5f2819b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 1 --2- 10.20.193.52:0/597686280 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5f2810a4d0 0x7f5f2819b460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5f18004290 tx=0x7f5f180042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 1 -- 10.20.193.52:0/597686280 shutdown_connections 2026-02-24T18:18:47.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 1 --2- 10.20.193.52:0/597686280 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f5f0403dc90 0x7f5f04040150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 1 --2- 10.20.193.52:0/597686280 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f5f2810a4d0 0x7f5f2819b460 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 1 -- 10.20.193.52:0/597686280 >> 10.20.193.52:0/597686280 conn(0x7f5f28100140 msgr2=0x7f5f28108720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 1 -- 10.20.193.52:0/597686280 shutdown_connections 2026-02-24T18:18:47.593 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.589+0000 7f5f2eec2640 1 -- 10.20.193.52:0/597686280 wait complete. 2026-02-24T18:18:47.594 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 10 mgrc shutdown 2026-02-24T18:18:47.594 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 1 -- 10.20.193.52:0/1609445637 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0b6c03dce0 msgr2=0x7f0b6c0401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.594 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 1 --2- 10.20.193.52:0/1609445637 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0b6c03dce0 0x7f0b6c0401a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b840099c0 tx=0x7f0b84006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.594 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 1 -- 10.20.193.52:0/1609445637 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0b90077620 msgr2=0x7f0b901a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:47.595 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 1 --2- 10.20.193.52:0/1609445637 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0b90077620 0x7f0b901a58c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b80002410 tx=0x7f0b80004290 comp rx=0 tx=0).stop 2026-02-24T18:18:47.595 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 1 -- 10.20.193.52:0/1609445637 shutdown_connections 2026-02-24T18:18:47.595 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 1 --2- 10.20.193.52:0/1609445637 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f0b6c03dce0 0x7f0b6c0401a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.595 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 1 --2- 10.20.193.52:0/1609445637 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f0b90077620 0x7f0b901a58c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:47.595 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 1 -- 10.20.193.52:0/1609445637 >> 10.20.193.52:0/1609445637 conn(0x7f0b901006d0 msgr2=0x7f0b901034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:47.595 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 1 -- 10.20.193.52:0/1609445637 shutdown_connections 2026-02-24T18:18:47.595 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:47.590+0000 7f0b98226640 1 -- 10.20.193.52:0/1609445637 wait complete. 2026-02-24T18:18:47.630 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2026-02-24T18:18:47.631 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2026-02-24T18:18:48.566 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T18:18:48.592 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:48 trial052 ceph-mon[39446]: pgmap v38: 1 pgs: 1 creating+activating; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T18:18:48.592 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:48 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1308384078' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-24T18:18:48.592 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:48 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/597686280' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-24T18:18:48.592 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:48 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/1609445637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-24T18:18:48.592 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:48 trial052 ceph-mon[39446]: osdmap e22: 3 total, 3 up, 3 in 2026-02-24T18:18:48.631 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T18:18:48.632 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T18:18:48.717 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:48.798 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:48.799 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:48.826 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.820+0000 7fa3367b8640 1 -- 10.20.193.52:0/108805440 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa330101140 msgr2=0x7fa330101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:48.826 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.820+0000 7fa3367b8640 1 --2- 10.20.193.52:0/108805440 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa330101140 0x7fa330101520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0099b0 tx=0x7fa31c02f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:48.826 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.820+0000 7fa3367b8640 1 -- 10.20.193.52:0/108805440 shutdown_connections 2026-02-24T18:18:48.826 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.820+0000 7fa3367b8640 1 --2- 10.20.193.52:0/108805440 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa330101140 0x7fa330101520 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:48.826 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.820+0000 7fa3367b8640 1 -- 10.20.193.52:0/108805440 >> 10.20.193.52:0/108805440 conn(0x7fa3300fcf50 msgr2=0x7fa3300ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:48.826 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.820+0000 7fa3367b8640 1 -- 10.20.193.52:0/108805440 shutdown_connections 2026-02-24T18:18:48.826 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.820+0000 7fa3367b8640 1 -- 10.20.193.52:0/108805440 wait complete. 2026-02-24T18:18:48.826 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.821+0000 7fa3367b8640 1 Processor -- start 2026-02-24T18:18:48.826 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.821+0000 7fa3367b8640 1 -- start start 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.821+0000 7fa3367b8640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa330101140 0x7fa33019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.821+0000 7fa3367b8640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa33010e0c0 con 0x7fa330101140 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.821+0000 7fa32ffff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa330101140 0x7fa33019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.821+0000 7fa32ffff640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa330101140 0x7fa33019b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46754/0 (socket says 10.20.193.52:46754) 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.821+0000 7fa32ffff640 1 -- 10.20.193.52:0/3704201353 learned_addr learned my addr 10.20.193.52:0/3704201353 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.821+0000 7fa32ffff640 1 -- 10.20.193.52:0/3704201353 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33019bc20 con 0x7fa330101140 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.821+0000 7fa32ffff640 1 --2- 10.20.193.52:0/3704201353 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa330101140 0x7fa33019b6e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa31c004290 tx=0x7fa31c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa32d7fa640 1 -- 10.20.193.52:0/3704201353 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa31c038510 con 0x7fa330101140 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa32d7fa640 1 -- 10.20.193.52:0/3704201353 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa31c046070 con 0x7fa330101140 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa3367b8640 1 -- 10.20.193.52:0/3704201353 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33019beb0 con 0x7fa330101140 2026-02-24T18:18:48.827 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa32d7fa640 1 -- 10.20.193.52:0/3704201353 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa31c041610 con 0x7fa330101140 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa3367b8640 1 -- 10.20.193.52:0/3704201353 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33019c310 con 0x7fa330101140 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa3367b8640 1 -- 10.20.193.52:0/3704201353 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa33006b7a0 con 0x7fa330101140 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa32d7fa640 1 -- 10.20.193.52:0/3704201353 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fa31c0418c0 con 0x7fa330101140 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa32d7fa640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa32d7fa640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa32d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa32d7fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa32d7fa640 1 --2- 10.20.193.52:0/3704201353 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa30403dce0 0x7fa3040401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.822+0000 7fa32d7fa640 1 -- 10.20.193.52:0/3704201353 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3015+0+0 (secure 0 0 0) 0x7fa31c0778f0 con 0x7fa330101140 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.823+0000 7fa32f7fe640 1 --2- 10.20.193.52:0/3704201353 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa30403dce0 0x7fa3040401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:48.828 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.823+0000 7fa32f7fe640 1 --2- 10.20.193.52:0/3704201353 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa30403dce0 0x7fa3040401a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3200099c0 tx=0x7fa320006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:48.829 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.825+0000 7fa32d7fa640 1 -- 10.20.193.52:0/3704201353 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa31c035320 con 0x7fa330101140 2026-02-24T18:18:48.908 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2448697932 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8e6410a640 msgr2=0x7f8e6410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:48.908 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 --2- 10.20.193.52:0/2448697932 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8e6410a640 0x7f8e6410aa20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8e540099b0 tx=0x7f8e5402f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:48.909 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2448697932 shutdown_connections 2026-02-24T18:18:48.909 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 --2- 10.20.193.52:0/2448697932 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8e6410a640 0x7f8e6410aa20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:48.909 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2448697932 >> 10.20.193.52:0/2448697932 conn(0x7f8e641006d0 msgr2=0x7f8e64102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:48.909 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2448697932 shutdown_connections 2026-02-24T18:18:48.909 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2448697932 wait complete. 2026-02-24T18:18:48.909 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7fe278db8640 1 -- 10.20.193.52:0/90462996 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe27410a650 msgr2=0x7fe27410aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:48.910 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7fe278db8640 1 --2- 10.20.193.52:0/90462996 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe27410a650 0x7fe27410aa30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe2680099b0 tx=0x7fe26802f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:48.910 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7fe278db8640 1 -- 10.20.193.52:0/90462996 shutdown_connections 2026-02-24T18:18:48.910 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7fe278db8640 1 --2- 10.20.193.52:0/90462996 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe27410a650 0x7fe27410aa30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:48.910 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7fe278db8640 1 -- 10.20.193.52:0/90462996 >> 10.20.193.52:0/90462996 conn(0x7fe274100330 msgr2=0x7fe274102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:48.910 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7fe278db8640 1 -- 10.20.193.52:0/90462996 shutdown_connections 2026-02-24T18:18:48.910 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7fe278db8640 1 -- 10.20.193.52:0/90462996 wait complete. 2026-02-24T18:18:48.911 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 Processor -- start 2026-02-24T18:18:48.911 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 -- start start 2026-02-24T18:18:48.911 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8e6410a640 0x7f8e6419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:48.911 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7f8e6ad06640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6410e050 con 0x7f8e6410a640 2026-02-24T18:18:48.911 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.905+0000 7fe278db8640 1 Processor -- start 2026-02-24T18:18:48.912 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e68a7b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8e6410a640 0x7f8e6419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:48.912 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e68a7b640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8e6410a640 0x7f8e6419b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46780/0 (socket says 10.20.193.52:46780) 2026-02-24T18:18:48.912 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e68a7b640 1 -- 10.20.193.52:0/2815605210 learned_addr learned my addr 10.20.193.52:0/2815605210 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:48.912 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe278db8640 1 -- start start 2026-02-24T18:18:48.913 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e68a7b640 1 -- 10.20.193.52:0/2815605210 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6419bbd0 con 0x7f8e6410a640 2026-02-24T18:18:48.913 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe278db8640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe27410a650 0x7fe27419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:48.913 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe278db8640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe27410e060 con 0x7fe27410a650 2026-02-24T18:18:48.914 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e68a7b640 1 --2- 10.20.193.52:0/2815605210 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8e6410a640 0x7f8e6419b690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e54004290 tx=0x7f8e540042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:48.914 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe272575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe27410a650 0x7fe27419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:48.914 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe272575640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe27410a650 0x7fe27419b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46788/0 (socket says 10.20.193.52:46788) 2026-02-24T18:18:48.914 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe272575640 1 -- 10.20.193.52:0/990594258 learned_addr learned my addr 10.20.193.52:0/990594258 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:48.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e59ffb640 1 -- 10.20.193.52:0/2815605210 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e54038510 con 0x7f8e6410a640 2026-02-24T18:18:48.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e59ffb640 1 -- 10.20.193.52:0/2815605210 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8e54046070 con 0x7f8e6410a640 2026-02-24T18:18:48.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2815605210 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6419be60 con 0x7f8e6410a640 2026-02-24T18:18:48.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e59ffb640 1 -- 10.20.193.52:0/2815605210 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e54041610 con 0x7f8e6410a640 2026-02-24T18:18:48.915 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe272575640 1 -- 10.20.193.52:0/990594258 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27419bbc0 con 0x7fe27410a650 2026-02-24T18:18:48.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2815605210 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6419ff60 con 0x7f8e6410a640 2026-02-24T18:18:48.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe272575640 1 --2- 10.20.193.52:0/990594258 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe27410a650 0x7fe27419b680 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe268004290 tx=0x7fe2680042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:48.916 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe25b7fe640 1 -- 10.20.193.52:0/990594258 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe268038510 con 0x7fe27410a650 2026-02-24T18:18:48.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe25b7fe640 1 -- 10.20.193.52:0/990594258 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe268046070 con 0x7fe27410a650 2026-02-24T18:18:48.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe278db8640 1 -- 10.20.193.52:0/990594258 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe27419be50 con 0x7fe27410a650 2026-02-24T18:18:48.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe25b7fe640 1 -- 10.20.193.52:0/990594258 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe268041610 con 0x7fe27410a650 2026-02-24T18:18:48.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7fe278db8640 1 -- 10.20.193.52:0/990594258 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe27419ff50 con 0x7fe27410a650 2026-02-24T18:18:48.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.906+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2815605210 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e64105d80 con 0x7f8e6410a640 2026-02-24T18:18:48.917 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7f8e59ffb640 1 -- 10.20.193.52:0/2815605210 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f8e540386b0 con 0x7f8e6410a640 2026-02-24T18:18:48.918 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7f8e59ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:48.918 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7fe278db8640 1 -- 10.20.193.52:0/990594258 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe274105d90 con 0x7fe27410a650 2026-02-24T18:18:48.918 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7f8e59ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:48.919 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7f8e59ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:48.919 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7f8e59ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:48.919 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7f8e59ffb640 1 --2- 10.20.193.52:0/2815605210 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8e4003dc90 0x7f8e40040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:48.919 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7f8e59ffb640 1 -- 10.20.193.52:0/2815605210 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3015+0+0 (secure 0 0 0) 0x7f8e540777e0 con 0x7f8e6410a640 2026-02-24T18:18:48.919 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7fe25b7fe640 1 -- 10.20.193.52:0/990594258 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fe2680386b0 con 0x7fe27410a650 2026-02-24T18:18:48.919 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7fe25b7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:48.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7f8e5bfff640 1 --2- 10.20.193.52:0/2815605210 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8e4003dc90 0x7f8e40040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:48.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7fe25b7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:48.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7fe25b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:48.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7fe25b7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:48.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7fe25b7fe640 1 --2- 10.20.193.52:0/990594258 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe24c03dc90 0x7fe24c040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:48.920 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7fe25b7fe640 1 -- 10.20.193.52:0/990594258 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3015+0+0 (secure 0 0 0) 0x7fe2680777e0 con 0x7fe27410a650 2026-02-24T18:18:48.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7f8e5bfff640 1 --2- 10.20.193.52:0/2815605210 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8e4003dc90 0x7f8e40040150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0099c0 tx=0x7f8e4c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:48.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7fe271d74640 1 --2- 10.20.193.52:0/990594258 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe24c03dc90 0x7fe24c040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:48.921 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.907+0000 7fe271d74640 1 --2- 10.20.193.52:0/990594258 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe24c03dc90 0x7fe24c040150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0099c0 tx=0x7fe25c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:48.922 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.911+0000 7f8e59ffb640 1 -- 10.20.193.52:0/2815605210 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8e54040360 con 0x7f8e6410a640 2026-02-24T18:18:48.922 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.912+0000 7fa3367b8640 1 -- 10.20.193.52:0/3704201353 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa33019ca40 con 0x7fa330101140 2026-02-24T18:18:48.922 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.913+0000 7fa32d7fa640 1 -- 10.20.193.52:0/3704201353 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa31c040360 con 0x7fa330101140 2026-02-24T18:18:48.922 INFO:teuthology.orchestra.run.trial052.stdout:77309411332 2026-02-24T18:18:48.923 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.913+0000 7fe25b7fe640 1 -- 10.20.193.52:0/990594258 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe268040360 con 0x7fe27410a650 2026-02-24T18:18:48.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 10 mgrc shutdown 2026-02-24T18:18:48.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 1 -- 10.20.193.52:0/3704201353 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa30403dce0 msgr2=0x7fa3040401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:48.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 1 --2- 10.20.193.52:0/3704201353 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa30403dce0 0x7fa3040401a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3200099c0 tx=0x7fa320006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:48.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 1 -- 10.20.193.52:0/3704201353 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa330101140 msgr2=0x7fa33019b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:48.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 1 --2- 10.20.193.52:0/3704201353 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa330101140 0x7fa33019b6e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa31c004290 tx=0x7fa31c0042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:48.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 1 -- 10.20.193.52:0/3704201353 shutdown_connections 2026-02-24T18:18:48.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 1 --2- 10.20.193.52:0/3704201353 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fa30403dce0 0x7fa3040401a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:48.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 1 --2- 10.20.193.52:0/3704201353 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fa330101140 0x7fa33019b6e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:48.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 1 -- 10.20.193.52:0/3704201353 >> 10.20.193.52:0/3704201353 conn(0x7fa3300fcf50 msgr2=0x7fa3300fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:48.924 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 1 -- 10.20.193.52:0/3704201353 shutdown_connections 2026-02-24T18:18:48.925 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.915+0000 7fa3367b8640 1 -- 10.20.193.52:0/3704201353 wait complete. 2026-02-24T18:18:48.956 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411332 for osd.2 2026-02-24T18:18:48.956 DEBUG:teuthology.parallel:result is None 2026-02-24T18:18:49.001 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.998+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2815605210 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8e6410aaa0 con 0x7f8e6410a640 2026-02-24T18:18:49.002 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.999+0000 7f8e59ffb640 1 -- 10.20.193.52:0/2815605210 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e54049360 con 0x7f8e6410a640 2026-02-24T18:18:49.002 INFO:teuthology.orchestra.run.trial052.stdout:60129542150 2026-02-24T18:18:49.003 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:48.999+0000 7fe278db8640 1 -- 10.20.193.52:0/990594258 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe27410aab0 con 0x7fe27410a650 2026-02-24T18:18:49.003 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7fe25b7fe640 1 -- 10.20.193.52:0/990594258 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe268049360 con 0x7fe27410a650 2026-02-24T18:18:49.003 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 10 mgrc shutdown 2026-02-24T18:18:49.003 INFO:teuthology.orchestra.run.trial052.stdout:38654705670 2026-02-24T18:18:49.004 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2815605210 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8e4003dc90 msgr2=0x7f8e40040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:49.004 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 1 --2- 10.20.193.52:0/2815605210 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8e4003dc90 0x7f8e40040150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0099c0 tx=0x7f8e4c006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.004 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2815605210 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8e6410a640 msgr2=0x7f8e6419b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:49.004 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 1 --2- 10.20.193.52:0/2815605210 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8e6410a640 0x7f8e6419b690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e54004290 tx=0x7f8e540042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.005 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2815605210 shutdown_connections 2026-02-24T18:18:49.005 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 1 --2- 10.20.193.52:0/2815605210 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f8e4003dc90 0x7f8e40040150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.005 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 1 --2- 10.20.193.52:0/2815605210 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f8e6410a640 0x7f8e6419b690 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.005 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2815605210 >> 10.20.193.52:0/2815605210 conn(0x7f8e641006d0 msgr2=0x7f8e64106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:49.005 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2815605210 shutdown_connections 2026-02-24T18:18:49.005 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.000+0000 7f8e6ad06640 1 -- 10.20.193.52:0/2815605210 wait complete. 2026-02-24T18:18:49.006 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 10 mgrc shutdown 2026-02-24T18:18:49.006 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 1 -- 10.20.193.52:0/990594258 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe24c03dc90 msgr2=0x7fe24c040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:49.006 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 1 --2- 10.20.193.52:0/990594258 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe24c03dc90 0x7fe24c040150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0099c0 tx=0x7fe25c006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.006 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 1 -- 10.20.193.52:0/990594258 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe27410a650 msgr2=0x7fe27419b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:49.006 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 1 --2- 10.20.193.52:0/990594258 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe27410a650 0x7fe27419b680 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe268004290 tx=0x7fe2680042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.006 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 1 -- 10.20.193.52:0/990594258 shutdown_connections 2026-02-24T18:18:49.006 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 1 --2- 10.20.193.52:0/990594258 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fe24c03dc90 0x7fe24c040150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.007 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 1 --2- 10.20.193.52:0/990594258 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fe27410a650 0x7fe27419b680 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.007 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 1 -- 10.20.193.52:0/990594258 >> 10.20.193.52:0/990594258 conn(0x7fe274100330 msgr2=0x7fe2741087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:49.007 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 1 -- 10.20.193.52:0/990594258 shutdown_connections 2026-02-24T18:18:49.007 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.001+0000 7fe278db8640 1 -- 10.20.193.52:0/990594258 wait complete. 2026-02-24T18:18:49.039 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2026-02-24T18:18:49.039 DEBUG:teuthology.parallel:result is None 2026-02-24T18:18:49.043 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2026-02-24T18:18:49.043 DEBUG:teuthology.parallel:result is None 2026-02-24T18:18:49.043 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T18:18:49.044 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T18:18:49.229 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:49.334 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.331+0000 7fc409eb3640 1 -- 10.20.193.52:0/1463965777 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc40410a640 msgr2=0x7fc40410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:49.334 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.331+0000 7fc409eb3640 1 --2- 10.20.193.52:0/1463965777 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc40410a640 0x7fc40410aa20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00099b0 tx=0x7fc3f002f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.334 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.331+0000 7fc409eb3640 1 -- 10.20.193.52:0/1463965777 shutdown_connections 2026-02-24T18:18:49.334 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.331+0000 7fc409eb3640 1 --2- 10.20.193.52:0/1463965777 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc40410a640 0x7fc40410aa20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.334 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.331+0000 7fc409eb3640 1 -- 10.20.193.52:0/1463965777 >> 10.20.193.52:0/1463965777 conn(0x7fc4041006d0 msgr2=0x7fc404102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:49.334 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.331+0000 7fc409eb3640 1 -- 10.20.193.52:0/1463965777 shutdown_connections 2026-02-24T18:18:49.334 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.331+0000 7fc409eb3640 1 -- 10.20.193.52:0/1463965777 wait complete. 2026-02-24T18:18:49.335 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc409eb3640 1 Processor -- start 2026-02-24T18:18:49.335 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc409eb3640 1 -- start start 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc409eb3640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc40410a640 0x7fc40419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc409eb3640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc40410e050 con 0x7fc40410a640 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc4037fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc40410a640 0x7fc40419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc4037fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc40410a640 0x7fc40419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46802/0 (socket says 10.20.193.52:46802) 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc4037fe640 1 -- 10.20.193.52:0/2745573601 learned_addr learned my addr 10.20.193.52:0/2745573601 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc4037fe640 1 -- 10.20.193.52:0/2745573601 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40419bb90 con 0x7fc40410a640 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc4037fe640 1 --2- 10.20.193.52:0/2745573601 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc40410a640 0x7fc40419b650 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0004290 tx=0x7fc3f00042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc400ff9640 1 -- 10.20.193.52:0/2745573601 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3f0038510 con 0x7fc40410a640 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc400ff9640 1 -- 10.20.193.52:0/2745573601 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc3f0046070 con 0x7fc40410a640 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc409eb3640 1 -- 10.20.193.52:0/2745573601 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40419be20 con 0x7fc40410a640 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc400ff9640 1 -- 10.20.193.52:0/2745573601 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3f0041610 con 0x7fc40410a640 2026-02-24T18:18:49.336 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.332+0000 7fc409eb3640 1 -- 10.20.193.52:0/2745573601 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40419ff20 con 0x7fc40410a640 2026-02-24T18:18:49.337 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.333+0000 7fc409eb3640 1 -- 10.20.193.52:0/2745573601 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc404105d80 con 0x7fc40410a640 2026-02-24T18:18:49.337 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.333+0000 7fc400ff9640 1 -- 10.20.193.52:0/2745573601 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fc3f00386b0 con 0x7fc40410a640 2026-02-24T18:18:49.337 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.333+0000 7fc400ff9640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-24T18:18:49.338 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.333+0000 7fc400ff9640 4 mgrc handle_mgr_map Got map version 13 2026-02-24T18:18:49.338 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.333+0000 7fc400ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:49.338 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.333+0000 7fc400ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:49.338 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.333+0000 7fc400ff9640 1 --2- 10.20.193.52:0/2745573601 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc3d803dce0 0x7fc3d80401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:49.338 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.333+0000 7fc400ff9640 1 -- 10.20.193.52:0/2745573601 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3015+0+0 (secure 0 0 0) 0x7fc3f0077840 con 0x7fc40410a640 2026-02-24T18:18:49.338 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.333+0000 7fc402ffd640 1 --2- 10.20.193.52:0/2745573601 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc3d803dce0 0x7fc3d80401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:49.338 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.333+0000 7fc402ffd640 1 --2- 10.20.193.52:0/2745573601 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc3d803dce0 0x7fc3d80401a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40099c0 tx=0x7fc3f4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:49.339 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.336+0000 7fc400ff9640 1 -- 10.20.193.52:0/2745573601 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc3f0040360 con 0x7fc40410a640 2026-02-24T18:18:49.420 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.417+0000 7fc409eb3640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-24T18:18:49.420 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.417+0000 7fc409eb3640 1 -- 10.20.193.52:0/2745573601 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc40410aaa0 con 0x7fc3d803dce0 2026-02-24T18:18:49.421 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.418+0000 7fc400ff9640 1 -- 10.20.193.52:0/2745573601 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9871 (secure 0 0 0) 0x7fc40410aaa0 con 0x7fc3d803dce0 2026-02-24T18:18:49.421 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.418+0000 7fc400ff9640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:18:49.421 INFO:teuthology.orchestra.run.trial052.stderr:dumped all 2026-02-24T18:18:49.421 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:49.422 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 10 mgrc shutdown 2026-02-24T18:18:49.423 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 1 -- 10.20.193.52:0/2745573601 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc3d803dce0 msgr2=0x7fc3d80401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:49.423 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 1 --2- 10.20.193.52:0/2745573601 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc3d803dce0 0x7fc3d80401a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40099c0 tx=0x7fc3f4006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.423 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 1 -- 10.20.193.52:0/2745573601 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc40410a640 msgr2=0x7fc40419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:49.423 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 1 --2- 10.20.193.52:0/2745573601 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc40410a640 0x7fc40419b650 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0004290 tx=0x7fc3f00042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.423 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 1 -- 10.20.193.52:0/2745573601 shutdown_connections 2026-02-24T18:18:49.423 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 1 --2- 10.20.193.52:0/2745573601 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fc3d803dce0 0x7fc3d80401a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.423 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 1 --2- 10.20.193.52:0/2745573601 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fc40410a640 0x7fc40419b650 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.423 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 1 -- 10.20.193.52:0/2745573601 >> 10.20.193.52:0/2745573601 conn(0x7fc4041006d0 msgr2=0x7fc404106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:49.423 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 1 -- 10.20.193.52:0/2745573601 shutdown_connections 2026-02-24T18:18:49.423 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.419+0000 7fc409eb3640 1 -- 10.20.193.52:0/2745573601 wait complete. 2026-02-24T18:18:49.457 INFO:teuthology.orchestra.run.trial052.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2026-02-24T18:18:49.150365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":83100,"kb_used_data":1688,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":2201926500,"statfs":{"total":2254857830400,"available":2254772736000,"internally_reserved":0,"allocated":1728512,"data_stored":1336896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"21'72","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-24T18:18:48.092506+0000","last_change":"2026-02-24T18:18:47.229269+0000","last_active":"2026-02-24T18:18:48.092506+0000","last_peered":"2026-02-24T18:18:48.092506+0000","last_clean":"2026-02-24T18:18:48.092506+0000","last_became_active":"2026-02-24T18:18:47.228737+0000","last_became_peered":"2026-02-24T18:18:47.228737+0000","last_unstale":"2026-02-24T18:18:48.092506+0000","last_undegraded":"2026-02-24T18:18:48.092506+0000","last_fullsized":"2026-02-24T18:18:48.092506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T18:18:46.085135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T18:18:46.085135+0000","last_clean_scrub_stamp":"2026-02-24T18:18:46.085135+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:04:22.594696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411332,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27140,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733976060,"statfs":{"total":751619276800,"available":751591485440,"internally_reserved":0,"allocated":172032,"data_stored":48463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":782336,"data_stored":646009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":774144,"data_stored":642424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T18:18:49.458 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T18:18:49.607 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:49.709 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 -- 10.20.193.52:0/1905614980 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb43810a640 msgr2=0x7fb43810aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:49.709 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 --2- 10.20.193.52:0/1905614980 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb43810a640 0x7fb43810aa20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb4280099b0 tx=0x7fb42802f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.709 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 -- 10.20.193.52:0/1905614980 shutdown_connections 2026-02-24T18:18:49.709 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 --2- 10.20.193.52:0/1905614980 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb43810a640 0x7fb43810aa20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.709 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 -- 10.20.193.52:0/1905614980 >> 10.20.193.52:0/1905614980 conn(0x7fb4381006d0 msgr2=0x7fb438102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:49.709 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 -- 10.20.193.52:0/1905614980 shutdown_connections 2026-02-24T18:18:49.709 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 -- 10.20.193.52:0/1905614980 wait complete. 2026-02-24T18:18:49.709 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:49 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/3704201353' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-24T18:18:49.709 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:49 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2815605210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-24T18:18:49.709 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:49 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/990594258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 Processor -- start 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 -- start start 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb43810a640 0x7fb43819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43ea9e640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb43810e050 con 0x7fb43810a640 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43c813640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb43810a640 0x7fb43819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43c813640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb43810a640 0x7fb43819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46826/0 (socket says 10.20.193.52:46826) 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.706+0000 7fb43c813640 1 -- 10.20.193.52:0/3007146325 learned_addr learned my addr 10.20.193.52:0/3007146325 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.707+0000 7fb43c813640 1 -- 10.20.193.52:0/3007146325 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43819bb90 con 0x7fb43810a640 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.707+0000 7fb43c813640 1 --2- 10.20.193.52:0/3007146325 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb43810a640 0x7fb43819b650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb428004290 tx=0x7fb4280042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.707+0000 7fb42dffb640 1 -- 10.20.193.52:0/3007146325 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb428038510 con 0x7fb43810a640 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.707+0000 7fb42dffb640 1 -- 10.20.193.52:0/3007146325 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fb428046070 con 0x7fb43810a640 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.707+0000 7fb43ea9e640 1 -- 10.20.193.52:0/3007146325 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43819be20 con 0x7fb43810a640 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.707+0000 7fb42dffb640 1 -- 10.20.193.52:0/3007146325 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb428041610 con 0x7fb43810a640 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.707+0000 7fb43ea9e640 1 -- 10.20.193.52:0/3007146325 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43819ff20 con 0x7fb43810a640 2026-02-24T18:18:49.710 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.707+0000 7fb42dffb640 1 -- 10.20.193.52:0/3007146325 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7fb4280386b0 con 0x7fb43810a640 2026-02-24T18:18:49.711 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.707+0000 7fb42dffb640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-24T18:18:49.711 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.707+0000 7fb43ea9e640 1 -- 10.20.193.52:0/3007146325 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb438105d80 con 0x7fb43810a640 2026-02-24T18:18:49.711 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.708+0000 7fb42dffb640 4 mgrc handle_mgr_map Got map version 14 2026-02-24T18:18:49.711 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.708+0000 7fb42dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:49.711 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.708+0000 7fb42dffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:49.711 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.708+0000 7fb42dffb640 1 --2- 10.20.193.52:0/3007146325 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fb41403dd70 0x7fb414040230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:49.711 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.708+0000 7fb42dffb640 1 -- 10.20.193.52:0/3007146325 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3015+0+0 (secure 0 0 0) 0x7fb428077960 con 0x7fb43810a640 2026-02-24T18:18:49.711 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.708+0000 7fb42ffff640 1 --2- 10.20.193.52:0/3007146325 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fb41403dd70 0x7fb414040230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:49.711 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.708+0000 7fb42ffff640 1 --2- 10.20.193.52:0/3007146325 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fb41403dd70 0x7fb414040230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4200099c0 tx=0x7fb420006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:49.713 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.710+0000 7fb42dffb640 1 -- 10.20.193.52:0/3007146325 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb428040360 con 0x7fb43810a640 2026-02-24T18:18:49.797 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.794+0000 7fb43ea9e640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-24T18:18:49.797 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.794+0000 7fb43ea9e640 1 -- 10.20.193.52:0/3007146325 --> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb43810aaa0 con 0x7fb41403dd70 2026-02-24T18:18:49.798 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.794+0000 7fb42dffb640 1 -- 10.20.193.52:0/3007146325 <== mgr.14150 v2:10.20.193.52:6800/2288435215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9871 (secure 0 0 0) 0x7fb43810aaa0 con 0x7fb41403dd70 2026-02-24T18:18:49.798 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.794+0000 7fb42dffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-24T18:18:49.798 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:49.799 INFO:teuthology.orchestra.run.trial052.stderr:dumped all 2026-02-24T18:18:49.800 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.795+0000 7fb43ea9e640 10 mgrc shutdown 2026-02-24T18:18:49.800 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.795+0000 7fb43ea9e640 1 -- 10.20.193.52:0/3007146325 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fb41403dd70 msgr2=0x7fb414040230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:49.800 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.795+0000 7fb43ea9e640 1 --2- 10.20.193.52:0/3007146325 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fb41403dd70 0x7fb414040230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4200099c0 tx=0x7fb420006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.800 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.795+0000 7fb43ea9e640 1 -- 10.20.193.52:0/3007146325 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb43810a640 msgr2=0x7fb43819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:49.800 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.795+0000 7fb43ea9e640 1 --2- 10.20.193.52:0/3007146325 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb43810a640 0x7fb43819b650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb428004290 tx=0x7fb4280042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.800 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.796+0000 7fb43ea9e640 1 -- 10.20.193.52:0/3007146325 shutdown_connections 2026-02-24T18:18:49.800 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.796+0000 7fb43ea9e640 1 --2- 10.20.193.52:0/3007146325 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7fb41403dd70 0x7fb414040230 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.800 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.796+0000 7fb43ea9e640 1 --2- 10.20.193.52:0/3007146325 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7fb43810a640 0x7fb43819b650 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:49.801 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.796+0000 7fb43ea9e640 1 -- 10.20.193.52:0/3007146325 >> 10.20.193.52:0/3007146325 conn(0x7fb4381006d0 msgr2=0x7fb438106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:49.801 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.796+0000 7fb43ea9e640 1 -- 10.20.193.52:0/3007146325 shutdown_connections 2026-02-24T18:18:49.801 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:49.796+0000 7fb43ea9e640 1 -- 10.20.193.52:0/3007146325 wait complete. 2026-02-24T18:18:49.834 INFO:teuthology.orchestra.run.trial052.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2026-02-24T18:18:49.150365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":83100,"kb_used_data":1688,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":2201926500,"statfs":{"total":2254857830400,"available":2254772736000,"internally_reserved":0,"allocated":1728512,"data_stored":1336896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"21'72","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-24T18:18:48.092506+0000","last_change":"2026-02-24T18:18:47.229269+0000","last_active":"2026-02-24T18:18:48.092506+0000","last_peered":"2026-02-24T18:18:48.092506+0000","last_clean":"2026-02-24T18:18:48.092506+0000","last_became_active":"2026-02-24T18:18:47.228737+0000","last_became_peered":"2026-02-24T18:18:47.228737+0000","last_unstale":"2026-02-24T18:18:48.092506+0000","last_undegraded":"2026-02-24T18:18:48.092506+0000","last_fullsized":"2026-02-24T18:18:48.092506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T18:18:46.085135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T18:18:46.085135+0000","last_clean_scrub_stamp":"2026-02-24T18:18:46.085135+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:04:22.594696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411332,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27140,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733976060,"statfs":{"total":751619276800,"available":751591485440,"internally_reserved":0,"allocated":172032,"data_stored":48463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":782336,"data_stored":646009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":774144,"data_stored":642424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T18:18:49.835 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T18:18:49.836 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T18:18:49.836 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-24T18:18:49.836 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f90f4eaebb28b619cf76e80cbbe997656da69579 shell --fsid 08cedbc6-11ad-11f1-a33f-d404e6e7d460 -- ceph health --format=json 2026-02-24T18:18:49.983 INFO:teuthology.orchestra.run.trial052.stderr:Inferring config /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/mon.a/config 2026-02-24T18:18:50.090 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.084+0000 7f79761f6640 1 -- 10.20.193.52:0/1609600413 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f797010a640 msgr2=0x7f797010aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:50.090 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.084+0000 7f79761f6640 1 --2- 10.20.193.52:0/1609600413 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f797010a640 0x7f797010aa20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f795c0099b0 tx=0x7f795c02f2b0 comp rx=0 tx=0).stop 2026-02-24T18:18:50.090 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.084+0000 7f79761f6640 1 -- 10.20.193.52:0/1609600413 shutdown_connections 2026-02-24T18:18:50.090 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.084+0000 7f79761f6640 1 --2- 10.20.193.52:0/1609600413 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f797010a640 0x7f797010aa20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:50.090 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.084+0000 7f79761f6640 1 -- 10.20.193.52:0/1609600413 >> 10.20.193.52:0/1609600413 conn(0x7f79701006d0 msgr2=0x7f7970102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:50.090 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.084+0000 7f79761f6640 1 -- 10.20.193.52:0/1609600413 shutdown_connections 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.084+0000 7f79761f6640 1 -- 10.20.193.52:0/1609600413 wait complete. 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f79761f6640 1 Processor -- start 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f79761f6640 1 -- start start 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f79761f6640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f797010a640 0x7f797019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f79761f6640 1 -- --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_getmap magic: 0 -- 0x7f797010e050 con 0x7f797010a640 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f796f7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f797010a640 0x7f797019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f796f7fe640 1 --2- >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f797010a640 0x7f797019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.52:3300/0 says I am v2:10.20.193.52:46856/0 (socket says 10.20.193.52:46856) 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f796f7fe640 1 -- 10.20.193.52:0/2392447812 learned_addr learned my addr 10.20.193.52:0/2392447812 (peer_addr_for_me v2:10.20.193.52:0/0) 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f796f7fe640 1 -- 10.20.193.52:0/2392447812 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797019bb90 con 0x7f797010a640 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f796f7fe640 1 --2- 10.20.193.52:0/2392447812 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f797010a640 0x7f797019b650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f795c004290 tx=0x7f795c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:50.091 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f796cff9640 1 -- 10.20.193.52:0/2392447812 <== mon.0 v2:10.20.193.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f795c038510 con 0x7f797010a640 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f796cff9640 1 -- 10.20.193.52:0/2392447812 <== mon.0 v2:10.20.193.52:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f795c046070 con 0x7f797010a640 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f79761f6640 1 -- 10.20.193.52:0/2392447812 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797019be20 con 0x7f797010a640 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f796cff9640 1 -- 10.20.193.52:0/2392447812 <== mon.0 v2:10.20.193.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f795c041610 con 0x7f797010a640 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.085+0000 7f79761f6640 1 -- 10.20.193.52:0/2392447812 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797019ff20 con 0x7f797010a640 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.086+0000 7f79761f6640 1 -- 10.20.193.52:0/2392447812 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7970105d80 con 0x7f797010a640 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.086+0000 7f796cff9640 1 -- 10.20.193.52:0/2392447812 <== mon.0 v2:10.20.193.52:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7f795c0386b0 con 0x7f797010a640 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.086+0000 7f796cff9640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.086+0000 7f796cff9640 4 mgrc handle_mgr_map Got map version 14 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.086+0000 7f796cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.086+0000 7f796cff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.086+0000 7f796cff9640 1 --2- 10.20.193.52:0/2392447812 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f794403dd70 0x7f7944040230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.086+0000 7f796cff9640 1 -- 10.20.193.52:0/2392447812 <== mon.0 v2:10.20.193.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3015+0+0 (secure 0 0 0) 0x7f795c0778c0 con 0x7f797010a640 2026-02-24T18:18:50.092 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.086+0000 7f796effd640 1 --2- 10.20.193.52:0/2392447812 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f794403dd70 0x7f7944040230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T18:18:50.093 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.087+0000 7f796effd640 1 --2- 10.20.193.52:0/2392447812 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f794403dd70 0x7f7944040230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f79600099c0 tx=0x7f7960006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T18:18:50.093 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.089+0000 7f796cff9640 1 -- 10.20.193.52:0/2392447812 <== mon.0 v2:10.20.193.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f795c040360 con 0x7f797010a640 2026-02-24T18:18:50.192 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.189+0000 7f79761f6640 1 -- 10.20.193.52:0/2392447812 --> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f797010aaa0 con 0x7f797010a640 2026-02-24T18:18:50.192 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.189+0000 7f796cff9640 1 -- 10.20.193.52:0/2392447812 <== mon.0 v2:10.20.193.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f795c049360 con 0x7f797010a640 2026-02-24T18:18:50.193 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:50.193 INFO:teuthology.orchestra.run.trial052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T18:18:50.194 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 10 mgrc shutdown 2026-02-24T18:18:50.194 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 1 -- 10.20.193.52:0/2392447812 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f794403dd70 msgr2=0x7f7944040230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:50.194 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 1 --2- 10.20.193.52:0/2392447812 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f794403dd70 0x7f7944040230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f79600099c0 tx=0x7f7960006eb0 comp rx=0 tx=0).stop 2026-02-24T18:18:50.194 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 1 -- 10.20.193.52:0/2392447812 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f797010a640 msgr2=0x7f797019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T18:18:50.195 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 1 --2- 10.20.193.52:0/2392447812 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f797010a640 0x7f797019b650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f795c004290 tx=0x7f795c0042c0 comp rx=0 tx=0).stop 2026-02-24T18:18:50.195 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 1 -- 10.20.193.52:0/2392447812 shutdown_connections 2026-02-24T18:18:50.195 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 1 --2- 10.20.193.52:0/2392447812 >> [v2:10.20.193.52:6800/2288435215,v1:10.20.193.52:6801/2288435215] conn(0x7f794403dd70 0x7f7944040230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:50.195 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 1 --2- 10.20.193.52:0/2392447812 >> [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] conn(0x7f797010a640 0x7f797019b650 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T18:18:50.195 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 1 -- 10.20.193.52:0/2392447812 >> 10.20.193.52:0/2392447812 conn(0x7f79701006d0 msgr2=0x7f7970106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T18:18:50.195 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 1 -- 10.20.193.52:0/2392447812 shutdown_connections 2026-02-24T18:18:50.195 INFO:teuthology.orchestra.run.trial052.stderr:2026-02-24T18:18:50.190+0000 7f79761f6640 1 -- 10.20.193.52:0/2392447812 wait complete. 2026-02-24T18:18:50.226 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-24T18:18:50.226 INFO:tasks.cephadm:Setup complete, yielding 2026-02-24T18:18:50.226 INFO:teuthology.run_tasks:Running task ceph... 2026-02-24T18:18:50.237 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-24T18:18:50.237 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(OSD_DOWN\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-24T18:18:50.237 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:22:43-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/68637', 'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'description': 'rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/e2e}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '68637', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-24_16:22:43-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'], ['host.b', 'client.1']], 'seed': 5907, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'targets': {'trial052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMB3UGSEWvf8QrlZlk1r4ObAFCyNcyHQV4Ey+mqdMPAXFPMV8qNj5Dr3U1MSqMLYbp1tQae4PiriX3U0mFmLB9I=', 'trial080.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNTWNVxn8+wKEsDd22woIeWOQm6rzbwNW3I4KAqbBv+wIOaQ8lHC6WFcJDzkLIF9qHtWvbw3HqPrVK/6QZ9NK5Y='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'pexec': {'all': ['sudo dnf remove nvme-cli -y', 'sudo dnf install nvmetcli nvme-cli -y']}}, {'install': None}, {'cephadm': None}, {'ceph': {'log-ignorelist': ['\\(OSD_DOWN\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.1': ['cephadm/create_iscsi_disks.sh']}}}, {'workunit': {'clients': {'client.0': ['cephadm/test_dashboard_e2e.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': 'e6d9099ce03dc21193fda653159ec82465c3a94a', 'timestamp': '2026-02-24_16:22:43', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-24T18:18:50.238 DEBUG:teuthology.orchestra.run.trial052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T18:18:50.239 DEBUG:teuthology.orchestra.run.trial080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T18:18:50.257 DEBUG:teuthology.orchestra.run.trial052:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T18:18:50.297 DEBUG:teuthology.orchestra.run.trial080:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T18:18:50.322 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:18:50.322 DEBUG:teuthology.orchestra.run.trial052:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T18:18:50.375 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T18:18:50.375 DEBUG:teuthology.orchestra.run.trial052:> stat /dev/vg_nvme/lv_1 2026-02-24T18:18:50.431 INFO:teuthology.orchestra.run.trial052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T18:18:50.431 INFO:teuthology.orchestra.run.trial052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:50.431 INFO:teuthology.orchestra.run.trial052.stdout:Device: 6h/6d Inode: 3609 Links: 1 2026-02-24T18:18:50.432 INFO:teuthology.orchestra.run.trial052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:50.432 INFO:teuthology.orchestra.run.trial052.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:50.432 INFO:teuthology.orchestra.run.trial052.stdout:Access: 2026-02-24 18:18:36.104828946 +0000 2026-02-24T18:18:50.432 INFO:teuthology.orchestra.run.trial052.stdout:Modify: 2026-02-24 18:18:35.490843088 +0000 2026-02-24T18:18:50.432 INFO:teuthology.orchestra.run.trial052.stdout:Change: 2026-02-24 18:18:35.490843088 +0000 2026-02-24T18:18:50.432 INFO:teuthology.orchestra.run.trial052.stdout: Birth: 2026-02-24 18:18:35.490843088 +0000 2026-02-24T18:18:50.432 DEBUG:teuthology.orchestra.run.trial052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T18:18:50.494 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records in 2026-02-24T18:18:50.494 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records out 2026-02-24T18:18:50.494 INFO:teuthology.orchestra.run.trial052.stderr:512 bytes copied, 0.000149527 s, 3.4 MB/s 2026-02-24T18:18:50.495 DEBUG:teuthology.orchestra.run.trial052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T18:18:50.553 DEBUG:teuthology.orchestra.run.trial052:> stat /dev/vg_nvme/lv_2 2026-02-24T18:18:50.611 INFO:teuthology.orchestra.run.trial052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T18:18:50.611 INFO:teuthology.orchestra.run.trial052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:50.611 INFO:teuthology.orchestra.run.trial052.stdout:Device: 6h/6d Inode: 3918 Links: 1 2026-02-24T18:18:50.611 INFO:teuthology.orchestra.run.trial052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:50.611 INFO:teuthology.orchestra.run.trial052.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:50.611 INFO:teuthology.orchestra.run.trial052.stdout:Access: 2026-02-24 18:18:41.074714468 +0000 2026-02-24T18:18:50.612 INFO:teuthology.orchestra.run.trial052.stdout:Modify: 2026-02-24 18:18:41.073714490 +0000 2026-02-24T18:18:50.612 INFO:teuthology.orchestra.run.trial052.stdout:Change: 2026-02-24 18:18:41.073714490 +0000 2026-02-24T18:18:50.612 INFO:teuthology.orchestra.run.trial052.stdout: Birth: 2026-02-24 18:18:41.073714490 +0000 2026-02-24T18:18:50.612 DEBUG:teuthology.orchestra.run.trial052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T18:18:50.673 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records in 2026-02-24T18:18:50.674 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records out 2026-02-24T18:18:50.674 INFO:teuthology.orchestra.run.trial052.stderr:512 bytes copied, 0.000116776 s, 4.4 MB/s 2026-02-24T18:18:50.675 DEBUG:teuthology.orchestra.run.trial052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T18:18:50.733 DEBUG:teuthology.orchestra.run.trial052:> stat /dev/vg_nvme/lv_3 2026-02-24T18:18:50.789 INFO:teuthology.orchestra.run.trial052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T18:18:50.790 INFO:teuthology.orchestra.run.trial052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:50.790 INFO:teuthology.orchestra.run.trial052.stdout:Device: 6h/6d Inode: 3256 Links: 1 2026-02-24T18:18:50.790 INFO:teuthology.orchestra.run.trial052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:50.790 INFO:teuthology.orchestra.run.trial052.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:50.790 INFO:teuthology.orchestra.run.trial052.stdout:Access: 2026-02-24 18:18:36.104828946 +0000 2026-02-24T18:18:50.790 INFO:teuthology.orchestra.run.trial052.stdout:Modify: 2026-02-24 18:18:30.221964454 +0000 2026-02-24T18:18:50.790 INFO:teuthology.orchestra.run.trial052.stdout:Change: 2026-02-24 18:18:30.221964454 +0000 2026-02-24T18:18:50.790 INFO:teuthology.orchestra.run.trial052.stdout: Birth: 2026-02-24 18:18:30.221964454 +0000 2026-02-24T18:18:50.791 DEBUG:teuthology.orchestra.run.trial052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T18:18:50.852 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:50 trial052 ceph-mon[39446]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T18:18:50.852 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:50 trial052 ceph-mon[39446]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T18:18:50.852 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:50 trial052 ceph-mon[39446]: mgrmap e14: a(active, since 56s) 2026-02-24T18:18:50.852 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:50 trial052 ceph-mon[39446]: from='client.? 10.20.193.52:0/2392447812' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-24T18:18:50.854 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records in 2026-02-24T18:18:50.854 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records out 2026-02-24T18:18:50.854 INFO:teuthology.orchestra.run.trial052.stderr:512 bytes copied, 2.727e-05 s, 18.8 MB/s 2026-02-24T18:18:50.855 DEBUG:teuthology.orchestra.run.trial052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T18:18:50.912 DEBUG:teuthology.orchestra.run.trial052:> stat /dev/vg_nvme/lv_4 2026-02-24T18:18:50.969 INFO:teuthology.orchestra.run.trial052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T18:18:50.970 INFO:teuthology.orchestra.run.trial052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T18:18:50.970 INFO:teuthology.orchestra.run.trial052.stdout:Device: 6h/6d Inode: 2380 Links: 1 2026-02-24T18:18:50.970 INFO:teuthology.orchestra.run.trial052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T18:18:50.970 INFO:teuthology.orchestra.run.trial052.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T18:18:50.970 INFO:teuthology.orchestra.run.trial052.stdout:Access: 2026-02-24 18:18:36.104828946 +0000 2026-02-24T18:18:50.970 INFO:teuthology.orchestra.run.trial052.stdout:Modify: 2026-02-24 18:18:19.210215412 +0000 2026-02-24T18:18:50.970 INFO:teuthology.orchestra.run.trial052.stdout:Change: 2026-02-24 18:18:19.210215412 +0000 2026-02-24T18:18:50.970 INFO:teuthology.orchestra.run.trial052.stdout: Birth: 2026-02-24 18:18:19.210215412 +0000 2026-02-24T18:18:50.971 DEBUG:teuthology.orchestra.run.trial052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T18:18:51.033 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records in 2026-02-24T18:18:51.033 INFO:teuthology.orchestra.run.trial052.stderr:1+0 records out 2026-02-24T18:18:51.034 INFO:teuthology.orchestra.run.trial052.stderr:512 bytes copied, 2.6639e-05 s, 19.2 MB/s 2026-02-24T18:18:51.035 DEBUG:teuthology.orchestra.run.trial052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T18:18:51.092 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-24T18:18:51.092 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-24T18:18:51.092 INFO:tasks.ceph:Generating config... 2026-02-24T18:18:51.095 INFO:tasks.ceph:[client] debug client = 20 2026-02-24T18:18:51.095 INFO:tasks.ceph:[client] debug mgrc = 20 2026-02-24T18:18:51.095 INFO:tasks.ceph:[client] debug ms = 1 2026-02-24T18:18:51.095 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-24T18:18:51.095 INFO:tasks.ceph:[mds] debug mgrc = 20 2026-02-24T18:18:51.095 INFO:tasks.ceph:[mgr] debug client = 20 2026-02-24T18:18:51.095 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-24T18:18:51.095 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-24T18:18:51.096 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-24T18:18:51.096 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-24T18:18:51.096 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-24T18:18:51.096 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-24T18:18:51.096 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-24T18:18:51.096 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2026-02-24T18:18:51.096 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-24T18:18:51.096 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-24T18:18:51.096 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2026-02-24T18:18:51.096 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2026-02-24T18:18:51.096 INFO:tasks.ceph:[osd] debug mgrc = 20 2026-02-24T18:18:51.096 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-24T18:18:51.097 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-24T18:18:51.097 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2026-02-24T18:18:51.097 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-24T18:18:51.097 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-24T18:18:51.097 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-24T18:18:51.097 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-24T18:18:51.097 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-24T18:18:51.097 INFO:tasks.ceph:Setting up mon.a... 2026-02-24T18:18:51.097 DEBUG:teuthology.orchestra.run.trial052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-24T18:18:51.167 INFO:teuthology.orchestra.run.trial052.stdout:creating /etc/ceph/ceph.keyring 2026-02-24T18:18:51.169 DEBUG:teuthology.orchestra.run.trial052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-24T18:18:51.247 DEBUG:teuthology.orchestra.run.trial052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T18:18:51.311 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.52')] 2026-02-24T18:18:51.311 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.52', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'mon.a': {}, 'mds': {'debug mgrc': 20}} 2026-02-24T18:18:51.312 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:18:51.312 DEBUG:teuthology.orchestra.run.trial052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T18:18:51.367 DEBUG:teuthology.orchestra.run.trial052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.52 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-24T18:18:51.437 INFO:teuthology.orchestra.run.trial052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-24T18:18:51.438 INFO:teuthology.orchestra.run.trial052.stdout:monmaptool: generated fsid 8ab2ab53-c1d5-431f-9a73-03e1ee45d5a0 2026-02-24T18:18:51.438 INFO:teuthology.orchestra.run.trial052.stdout:setting min_mon_release = quincy 2026-02-24T18:18:51.438 INFO:teuthology.orchestra.run.trial052.stdout:epoch 0 2026-02-24T18:18:51.438 INFO:teuthology.orchestra.run.trial052.stdout:fsid 8ab2ab53-c1d5-431f-9a73-03e1ee45d5a0 2026-02-24T18:18:51.438 INFO:teuthology.orchestra.run.trial052.stdout:last_changed 2026-02-24T18:18:51.436555+0000 2026-02-24T18:18:51.438 INFO:teuthology.orchestra.run.trial052.stdout:created 2026-02-24T18:18:51.436555+0000 2026-02-24T18:18:51.438 INFO:teuthology.orchestra.run.trial052.stdout:min_mon_release 17 (quincy) 2026-02-24T18:18:51.438 INFO:teuthology.orchestra.run.trial052.stdout:election_strategy: 3 2026-02-24T18:18:51.438 INFO:teuthology.orchestra.run.trial052.stdout:0: [v2:10.20.193.52:3300/0,v1:10.20.193.52:6789/0] mon.a 2026-02-24T18:18:51.438 INFO:teuthology.orchestra.run.trial052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-24T18:18:51.441 DEBUG:teuthology.orchestra.run.trial052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T18:18:51.496 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8ab2ab53-c1d5-431f-9a73-03e1ee45d5a0... 2026-02-24T18:18:51.499 DEBUG:teuthology.orchestra.run.trial052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T18:18:51.538 DEBUG:teuthology.orchestra.run.trial080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T18:18:51.577 INFO:teuthology.orchestra.run.trial052.stdout:[global] 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: chdir = "" 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: auth supported = cephx 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: filestore xattr use omap = true 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: mon clock drift allowed = 1.000 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: osd crush chooseleaf type = 0 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: auth debug = true 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: ms die on old message = true 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: ms die on bug = true 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: mon pg warn max object skew = 0 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T18:18:51.578 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: osd pool default size = 2 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: mon osd allow primary affinity = true 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: mon osd allow pg remap = true 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: mon warn on legacy crush tunables = false 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: mon warn on crush straw calc version zero = false 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: mon warn on no sortbitwise = false 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: mon warn on osd down out interval zero = false 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: mon warn on too few osds = false 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T18:18:51.579 INFO:teuthology.orchestra.run.trial052.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: mon_allow_pool_size_one = true 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: osd default data pool replay window = 5 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: mon allow pool delete = true 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: mon cluster log file level = debug 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: debug asserts on shutdown = true 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: mon health detail to clog = false 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: mon host = 10.20.193.52 2026-02-24T18:18:51.580 INFO:teuthology.orchestra.run.trial052.stdout: mon election default strategy = 3 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: fsid = 8ab2ab53-c1d5-431f-9a73-03e1ee45d5a0 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout:[osd] 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: osd journal size = 100 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: osd scrub load threshold = 5.0 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: osd scrub max interval = 600 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: osd mclock profile = high_recovery_ops 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: osd mclock skip benchmark = true 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: osd recover clone overlap = true 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: osd recovery max chunk = 1048576 2026-02-24T18:18:51.581 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: osd debug shutdown = true 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: osd debug op order = true 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: osd debug verify stray on activate = true 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: osd debug trim objects = true 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: osd open classes on start = true 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: osd debug pg log writeout = true 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: osd deep scrub update digest min age = 30 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: osd map max advance = 10 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: journal zero on create = true 2026-02-24T18:18:51.582 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: filestore ondisk finisher threads = 3 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: filestore apply finisher threads = 3 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: bdev debug aio = true 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: osd debug misdirected ops = true 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: bdev async discard = True 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: bdev enable discard = True 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: bluestore allocator = bitmap 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: bluestore block size = 96636764160 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: bluestore fsck on mount = True 2026-02-24T18:18:51.583 INFO:teuthology.orchestra.run.trial052.stdout: debug bluefs = 1/20 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: debug bluestore = 1/20 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: debug mgrc = 20 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: debug ms = 1 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: debug osd = 20 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: debug rocksdb = 4/10 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: mon osd full ratio = 0.9 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: mon osd nearfull ratio = 0.8 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: osd failsafe full ratio = 0.95 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: osd objectstore = bluestore 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout:[mgr] 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: debug ms = 1 2026-02-24T18:18:51.584 INFO:teuthology.orchestra.run.trial052.stdout: debug mgr = 20 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: debug mon = 20 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: debug auth = 20 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: mon reweight min pgs per osd = 4 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: mon reweight min bytes per osd = 10 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: mgr/telemetry/nag = false 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: debug client = 20 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout:[mon] 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: debug ms = 1 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: debug mon = 20 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: debug paxos = 20 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: debug auth = 20 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: mon data avail warn = 5 2026-02-24T18:18:51.585 INFO:teuthology.orchestra.run.trial052.stdout: mon mgr mkfs grace = 240 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: mon reweight min pgs per osd = 4 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: mon osd reporter subtree level = osd 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: mon osd prime pg temp = true 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: mon reweight min bytes per osd = 10 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.586 INFO:teuthology.orchestra.run.trial052.stdout: # 1m isn't quite enough 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: mon_down_mkfs_grace = 2m 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: mon_warn_on_filestore_osds = false 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout:[client] 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: rgw cache enabled = true 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: rgw enable ops log = true 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: rgw enable usage log = true 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: debug client = 20 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: debug mgrc = 20 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout: debug ms = 1 2026-02-24T18:18:51.587 INFO:teuthology.orchestra.run.trial052.stdout:[mon.a] 2026-02-24T18:18:51.588 INFO:teuthology.orchestra.run.trial052.stdout:[mds] 2026-02-24T18:18:51.588 INFO:teuthology.orchestra.run.trial052.stdout: debug mgrc = 20 2026-02-24T18:18:51.588 INFO:teuthology.orchestra.run.trial080.stdout:[global] 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: chdir = "" 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: auth supported = cephx 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: filestore xattr use omap = true 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: mon clock drift allowed = 1.000 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: osd crush chooseleaf type = 0 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: auth debug = true 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.589 INFO:teuthology.orchestra.run.trial080.stdout: ms die on old message = true 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: ms die on bug = true 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: mon pg warn max object skew = 0 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: osd pool default size = 2 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: mon osd allow primary affinity = true 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: mon osd allow pg remap = true 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: mon warn on legacy crush tunables = false 2026-02-24T18:18:51.590 INFO:teuthology.orchestra.run.trial080.stdout: mon warn on crush straw calc version zero = false 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: mon warn on no sortbitwise = false 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: mon warn on osd down out interval zero = false 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: mon warn on too few osds = false 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: mon_allow_pool_size_one = true 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: osd default data pool replay window = 5 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: mon allow pool delete = true 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.591 INFO:teuthology.orchestra.run.trial080.stdout: mon cluster log file level = debug 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: debug asserts on shutdown = true 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: mon health detail to clog = false 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: mon host = 10.20.193.52 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: mon election default strategy = 3 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: fsid = 8ab2ab53-c1d5-431f-9a73-03e1ee45d5a0 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout:[osd] 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: osd journal size = 100 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: osd scrub load threshold = 5.0 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: osd scrub max interval = 600 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: osd mclock profile = high_recovery_ops 2026-02-24T18:18:51.592 INFO:teuthology.orchestra.run.trial080.stdout: osd mclock skip benchmark = true 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: osd recover clone overlap = true 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: osd recovery max chunk = 1048576 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: osd debug shutdown = true 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: osd debug op order = true 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: osd debug verify stray on activate = true 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: osd debug trim objects = true 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: osd open classes on start = true 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: osd debug pg log writeout = true 2026-02-24T18:18:51.593 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: osd deep scrub update digest min age = 30 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: osd map max advance = 10 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: journal zero on create = true 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: filestore ondisk finisher threads = 3 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: filestore apply finisher threads = 3 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: bdev debug aio = true 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: osd debug misdirected ops = true 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: bdev async discard = True 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: bdev enable discard = True 2026-02-24T18:18:51.594 INFO:teuthology.orchestra.run.trial080.stdout: bluestore allocator = bitmap 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: bluestore block size = 96636764160 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: bluestore fsck on mount = True 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: debug bluefs = 1/20 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: debug bluestore = 1/20 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: debug mgrc = 20 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: debug ms = 1 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: debug osd = 20 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: debug rocksdb = 4/10 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: mon osd full ratio = 0.9 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: mon osd nearfull ratio = 0.8 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: osd failsafe full ratio = 0.95 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: osd objectstore = bluestore 2026-02-24T18:18:51.595 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout:[mgr] 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: debug ms = 1 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: debug mgr = 20 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: debug mon = 20 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: debug auth = 20 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: mon reweight min pgs per osd = 4 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: mon reweight min bytes per osd = 10 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: mgr/telemetry/nag = false 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: debug client = 20 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout:[mon] 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: debug ms = 1 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: debug mon = 20 2026-02-24T18:18:51.596 INFO:teuthology.orchestra.run.trial080.stdout: debug paxos = 20 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: debug auth = 20 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: mon data avail warn = 5 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: mon mgr mkfs grace = 240 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: mon reweight min pgs per osd = 4 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: mon osd reporter subtree level = osd 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: mon osd prime pg temp = true 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: mon reweight min bytes per osd = 10 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T18:18:51.597 INFO:teuthology.orchestra.run.trial080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: # 1m isn't quite enough 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: mon_down_mkfs_grace = 2m 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: mon_warn_on_filestore_osds = false 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout:[client] 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: rgw cache enabled = true 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: rgw enable ops log = true 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: rgw enable usage log = true 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: debug client = 20 2026-02-24T18:18:51.598 INFO:teuthology.orchestra.run.trial080.stdout: debug mgrc = 20 2026-02-24T18:18:51.599 INFO:teuthology.orchestra.run.trial080.stdout: debug ms = 1 2026-02-24T18:18:51.599 INFO:teuthology.orchestra.run.trial080.stdout:[mon.a] 2026-02-24T18:18:51.599 INFO:teuthology.orchestra.run.trial080.stdout:[mds] 2026-02-24T18:18:51.599 INFO:teuthology.orchestra.run.trial080.stdout: debug mgrc = 20 2026-02-24T18:18:51.601 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-24T18:18:51.601 DEBUG:teuthology.orchestra.run.trial052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-24T18:18:51.681 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-24T18:18:51.682 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:18:51.682 DEBUG:teuthology.orchestra.run.trial052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-24T18:18:51.738 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:18:51.738 DEBUG:teuthology.orchestra.run.trial052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-24T18:18:51.795 INFO:tasks.ceph:Sending monmap to node ubuntu@trial052.front.sepia.ceph.com 2026-02-24T18:18:51.796 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:18:51.796 DEBUG:teuthology.orchestra.run.trial052:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T18:18:51.796 DEBUG:teuthology.orchestra.run.trial052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T18:18:51.856 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:51 trial052 ceph-mon[39446]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T18:18:51.868 DEBUG:teuthology.orchestra.run.trial052:> set -ex 2026-02-24T18:18:51.868 DEBUG:teuthology.orchestra.run.trial052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T18:18:51.925 INFO:tasks.ceph:Sending monmap to node ubuntu@trial080.front.sepia.ceph.com 2026-02-24T18:18:51.925 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:18:51.925 DEBUG:teuthology.orchestra.run.trial080:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T18:18:51.926 DEBUG:teuthology.orchestra.run.trial080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T18:18:51.961 DEBUG:teuthology.orchestra.run.trial080:> set -ex 2026-02-24T18:18:51.961 DEBUG:teuthology.orchestra.run.trial080:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T18:18:52.017 INFO:tasks.ceph:Setting up mon nodes... 2026-02-24T18:18:52.018 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-24T18:18:52.019 DEBUG:teuthology.orchestra.run.trial052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.a /var/lib/ceph/mgr/ceph-a/keyring 2026-02-24T18:18:52.064 INFO:teuthology.orchestra.run.trial052.stdout:creating /var/lib/ceph/mgr/ceph-a/keyring 2026-02-24T18:18:52.067 INFO:tasks.ceph:Setting up mds nodes... 2026-02-24T18:18:52.067 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-24T18:18:52.067 DEBUG:teuthology.orchestra.run.trial052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T18:18:52.102 INFO:teuthology.orchestra.run.trial052.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-24T18:18:52.113 DEBUG:teuthology.orchestra.run.trial080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-24T18:18:52.150 INFO:teuthology.orchestra.run.trial080.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-24T18:18:52.161 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-24T18:18:52.161 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-24T18:18:52.162 DEBUG:teuthology.orchestra.run.trial052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-24T18:18:52.186 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-24T18:18:52.186 INFO:tasks.ceph:role: osd.0 2026-02-24T18:18:52.186 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial052.front.sepia.ceph.com 2026-02-24T18:18:52.186 DEBUG:teuthology.orchestra.run.trial052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T18:18:52.251 INFO:teuthology.orchestra.run.trial052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T18:18:52.252 INFO:teuthology.orchestra.run.trial052.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T18:18:52.252 INFO:teuthology.orchestra.run.trial052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T18:18:52.252 INFO:teuthology.orchestra.run.trial052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T18:18:52.252 INFO:teuthology.orchestra.run.trial052.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T18:18:52.252 INFO:teuthology.orchestra.run.trial052.stdout: = sunit=0 swidth=0 blks 2026-02-24T18:18:52.252 INFO:teuthology.orchestra.run.trial052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T18:18:52.252 INFO:teuthology.orchestra.run.trial052.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T18:18:52.252 INFO:teuthology.orchestra.run.trial052.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T18:18:52.252 INFO:teuthology.orchestra.run.trial052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T18:18:52.828 INFO:teuthology.orchestra.run.trial052.stdout:Discarding blocks...Done. 2026-02-24T18:18:52.828 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:52 trial052 ceph-mon[39446]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T18:18:52.830 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial052.front.sepia.ceph.com -o noatime 2026-02-24T18:18:52.830 DEBUG:teuthology.orchestra.run.trial052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-24T18:18:52.904 DEBUG:teuthology.orchestra.run.trial052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-24T18:18:52.971 DEBUG:teuthology.orchestra.run.trial052:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-24T18:18:53.036 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-24T18:18:53.036 INFO:tasks.ceph:role: osd.1 2026-02-24T18:18:53.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial052.front.sepia.ceph.com 2026-02-24T18:18:53.036 DEBUG:teuthology.orchestra.run.trial052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T18:18:53.099 INFO:teuthology.orchestra.run.trial052.stderr:mkfs.xfs: cannot open /dev/vg_nvme/lv_2: Device or resource busy 2026-02-24T18:18:53.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:18:53.100 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048', '-f'] on /dev/vg_nvme/lv_2 on ubuntu@trial052.front.sepia.ceph.com 2026-02-24T18:18:53.101 DEBUG:teuthology.orchestra.run.trial052:> yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2 2026-02-24T18:18:53.164 INFO:teuthology.orchestra.run.trial052.stderr:mkfs.xfs: cannot open /dev/vg_nvme/lv_2: Device or resource busy 2026-02-24T18:18:53.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:18:53.167 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/ceph.py", line 924, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial052 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 32, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/ceph.py", line 931, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial052 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2' 2026-02-24T18:18:53.174 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/ceph.py", line 924, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial052 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/ceph.py", line 1919, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 56, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 32, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/ceph.py", line 931, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial052 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2' 2026-02-24T18:18:53.178 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-24T18:18:53.198 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-24T18:18:53.214 INFO:tasks.cephadm:Teardown begin 2026-02-24T18:18:53.214 DEBUG:teuthology.orchestra.run.trial052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T18:18:53.238 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T18:18:53.263 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-24T18:18:53.263 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-24T18:18:53.266 DEBUG:teuthology.misc:Transferring archived files from trial052:/var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:22:43-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/68637/remote/trial052/crash 2026-02-24T18:18:53.267 DEBUG:teuthology.orchestra.run.trial052:> sudo tar c -f - -C /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/crash -- . 2026-02-24T18:18:53.309 DEBUG:teuthology.misc:Transferring archived files from trial080:/var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:22:43-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/68637/remote/trial080/crash 2026-02-24T18:18:53.311 DEBUG:teuthology.orchestra.run.trial080:> sudo tar c -f - -C /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/crash -- . 2026-02-24T18:18:53.335 INFO:teuthology.orchestra.run.trial080.stderr:tar: /var/lib/ceph/08cedbc6-11ad-11f1-a33f-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T18:18:53.336 INFO:teuthology.orchestra.run.trial080.stderr:tar: Error is not recoverable: exiting now 2026-02-24T18:18:53.337 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-24T18:18:53.337 INFO:tasks.cephadm:Removing cluster... 2026-02-24T18:18:53.338 DEBUG:teuthology.orchestra.run.trial052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8ab2ab53-c1d5-431f-9a73-03e1ee45d5a0 --force 2026-02-24T18:18:53.464 INFO:teuthology.orchestra.run.trial052.stdout:Deleting cluster with fsid: 8ab2ab53-c1d5-431f-9a73-03e1ee45d5a0 2026-02-24T18:18:53.544 DEBUG:teuthology.orchestra.run.trial080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8ab2ab53-c1d5-431f-9a73-03e1ee45d5a0 --force 2026-02-24T18:18:53.655 INFO:teuthology.orchestra.run.trial080.stdout:Deleting cluster with fsid: 8ab2ab53-c1d5-431f-9a73-03e1ee45d5a0 2026-02-24T18:18:53.726 INFO:tasks.cephadm:Removing cephadm ... 2026-02-24T18:18:53.726 DEBUG:teuthology.orchestra.run.trial052:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T18:18:53.743 DEBUG:teuthology.orchestra.run.trial080:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T18:18:53.759 INFO:tasks.cephadm:Teardown complete 2026-02-24T18:18:53.759 ERROR:teuthology.run_tasks:Manager failed: cephadm Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 48, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 56, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 48, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-24T18:18:53.763 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T18:18:53.788 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 48, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 56, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 48, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-24T18:18:53.791 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T18:18:53.791 DEBUG:teuthology.orchestra.run.trial052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T18:18:53.794 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T18:18:53.983 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T18:18:54.011 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T18:18:54.011 DEBUG:teuthology.orchestra.run.trial052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:18:54.013 DEBUG:teuthology.orchestra.run.trial080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:18:54.028 INFO:teuthology.orchestra.run.trial052.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:18:54.029 INFO:teuthology.orchestra.run.trial080.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial052.stdout:=============================================================================== 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial052.stdout:^- 69.9.131.124 2 6 16 164 +7136us[+7378us] +/- 92ms 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial052.stdout:^* 50.205.57.38 1 6 77 33 -64us[ -70us] +/- 5195us 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial052.stdout:^- 172-234-25-10.ip.linodeu> 2 6 77 32 -7013us[-7013us] +/- 76ms 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial052.stdout:^- ntp.speculation.org 2 6 77 32 -2568us[-2568us] +/- 59ms 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial080.stdout:=============================================================================== 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial080.stdout:^- 69.9.131.124 2 6 77 33 +6344us[+6344us] +/- 92ms 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial080.stdout:^* 50.205.57.38 1 6 77 33 -38us[ -448us] +/- 4745us 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial080.stdout:^- 172-234-25-10.ip.linodeu> 2 6 77 33 -6516us[-6516us] +/- 76ms 2026-02-24T18:18:54.054 INFO:teuthology.orchestra.run.trial080.stdout:^- ntp.speculation.org 2 6 77 33 -2711us[-2711us] +/- 59ms 2026-02-24T18:18:54.055 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T18:18:54.069 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T18:18:54.069 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T18:18:54.083 DEBUG:teuthology.orchestra.run.trial052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T18:18:54.150 DEBUG:teuthology.orchestra.run.trial080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T18:18:54.205 DEBUG:teuthology.orchestra.run.trial052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-24T18:18:54.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:18:54.233 DEBUG:teuthology.orchestra.run.trial080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-24T18:18:54.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:18:54.260 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T18:18:54.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T18:18:54.314 INFO:teuthology.task.internal:Duration was 345.304298 seconds 2026-02-24T18:18:54.315 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T18:18:54.331 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T18:18:54.331 DEBUG:teuthology.orchestra.run.trial052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T18:18:54.334 DEBUG:teuthology.orchestra.run.trial080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T18:18:54.369 INFO:teuthology.orchestra.run.trial052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:18:54.372 INFO:teuthology.orchestra.run.trial080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:18:54.481 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T18:18:54.481 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial052.front.sepia.ceph.com 2026-02-24T18:18:54.482 DEBUG:teuthology.orchestra.run.trial052:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T18:18:54.501 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial080.front.sepia.ceph.com 2026-02-24T18:18:54.502 DEBUG:teuthology.orchestra.run.trial080:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T18:18:54.540 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T18:18:54.540 DEBUG:teuthology.orchestra.run.trial052:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T18:18:54.544 DEBUG:teuthology.orchestra.run.trial080:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T18:18:54.664 INFO:journalctl@ceph.mon.a.trial052.stdout:Feb 24 18:18:54 trial052 ceph-mon[39446]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T18:18:54.666 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T18:18:54.666 DEBUG:teuthology.orchestra.run.trial052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T18:18:54.668 DEBUG:teuthology.orchestra.run.trial080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T18:18:54.689 INFO:teuthology.orchestra.run.trial052.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:18:54.690 INFO:teuthology.orchestra.run.trial052.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:18:54.691 INFO:teuthology.orchestra.run.trial052.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T18:18:54.691 INFO:teuthology.orchestra.run.trial052.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T18:18:54.691 INFO:teuthology.orchestra.run.trial052.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T18:18:54.692 INFO:teuthology.orchestra.run.trial080.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:18:54.693 INFO:teuthology.orchestra.run.trial080.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:18:54.693 INFO:teuthology.orchestra.run.trial080.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T18:18:54.693 INFO:teuthology.orchestra.run.trial080.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T18:18:54.693 INFO:teuthology.orchestra.run.trial080.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T18:18:54.703 INFO:teuthology.orchestra.run.trial080.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T18:18:54.711 INFO:teuthology.orchestra.run.trial052.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T18:18:54.714 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T18:18:54.731 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T18:18:54.731 DEBUG:teuthology.orchestra.run.trial052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T18:18:54.777 DEBUG:teuthology.orchestra.run.trial080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T18:18:54.803 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T18:18:54.816 DEBUG:teuthology.orchestra.run.trial052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T18:18:54.820 DEBUG:teuthology.orchestra.run.trial080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T18:18:54.841 INFO:teuthology.orchestra.run.trial052.stdout:kernel.core_pattern = core 2026-02-24T18:18:54.866 INFO:teuthology.orchestra.run.trial080.stdout:kernel.core_pattern = core 2026-02-24T18:18:54.880 DEBUG:teuthology.orchestra.run.trial052:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T18:18:54.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:18:54.910 DEBUG:teuthology.orchestra.run.trial080:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T18:18:54.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:18:54.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T18:18:54.973 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T18:18:54.974 DEBUG:teuthology.misc:Transferring archived files from trial052:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:22:43-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/68637/remote/trial052 2026-02-24T18:18:54.975 DEBUG:teuthology.orchestra.run.trial052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T18:18:55.019 DEBUG:teuthology.misc:Transferring archived files from trial080:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:22:43-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/68637/remote/trial080 2026-02-24T18:18:55.019 DEBUG:teuthology.orchestra.run.trial080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T18:18:55.061 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T18:18:55.062 DEBUG:teuthology.orchestra.run.trial052:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T18:18:55.065 DEBUG:teuthology.orchestra.run.trial080:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T18:18:55.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T18:18:55.123 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T18:18:55.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T18:18:55.140 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T18:18:55.141 DEBUG:teuthology.orchestra.run.trial052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T18:18:55.143 DEBUG:teuthology.orchestra.run.trial080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T18:18:55.157 INFO:teuthology.orchestra.run.trial052.stdout: 917521 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 24 18:18 /home/ubuntu/cephtest 2026-02-24T18:18:55.158 INFO:teuthology.orchestra.run.trial052.stdout: 922648 4 -rw-r--r-- 1 ubuntu ubuntu 201 Feb 24 18:18 /home/ubuntu/cephtest/ceph.monmap 2026-02-24T18:18:55.158 INFO:teuthology.orchestra.run.trial052.stdout: 922646 4 -rw-r--r-- 1 root root 123 Feb 24 18:17 /home/ubuntu/cephtest/ceph.pub 2026-02-24T18:18:55.158 INFO:teuthology.orchestra.run.trial052.stdout: 922642 4 -rw-r--r-- 1 ubuntu ubuntu 3103 Feb 24 18:17 /home/ubuntu/cephtest/seed.ceph.conf 2026-02-24T18:18:55.158 INFO:teuthology.orchestra.run.trial052.stdout: 1190818 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 18:18 /home/ubuntu/cephtest/ceph.data 2026-02-24T18:18:55.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:18:55.159 INFO:teuthology.orchestra.run.trial052.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-24T18:18:55.159 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 48, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 56, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 48, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial052 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-24T18:18:55.166 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T18:18:55.184 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T18:18:55.203 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-24T18:18:55.207 INFO:teuthology.run:Summary data: description: rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/e2e} duration: 345.3042984008789 failure_reason: 'Command failed on trial052 with status 1: ''yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2''' flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-24T18:18:55.207 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T18:18:55.212 INFO:teuthology.orchestra.run.trial080.stdout: 920834 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 24 18:18 /home/ubuntu/cephtest 2026-02-24T18:18:55.212 INFO:teuthology.orchestra.run.trial080.stdout: 922644 4 -rw-r--r-- 1 ubuntu ubuntu 201 Feb 24 18:18 /home/ubuntu/cephtest/ceph.monmap 2026-02-24T18:18:55.212 INFO:teuthology.orchestra.run.trial080.stdout: 1310730 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 18:18 /home/ubuntu/cephtest/ceph.data 2026-02-24T18:18:55.213 INFO:teuthology.orchestra.run.trial080.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-24T18:18:55.328 INFO:teuthology.run:FAIL